2024-02-26T12:08:11.209 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-26T12:08:11.210 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --archive /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678 --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/orig.config.yaml 2024-02-26T12:08:11.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T12:08:11.351 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678 branch: wip-vshankar-testing-20240226.064629 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7573678' kernel: client: sha1: distro flavor: default kdb: true sha1: 7c0fbba6c508351b48a34af7de7b074eb29ad0f9 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240226.064629 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240226.064629 sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1879 sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 sleep_before_teardown: 0 subset: 788/1024 suite: fs suite_branch: wip-vshankar-testing-20240226.064629 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgzMb4SBKi8jhHofJlLFfmtu836Acx1Nmgnsi5e34UU9FNLewFT06lf/7kXOXGo6XbXAkGBYBbeyslye0Ym2ro= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCag7Cl00dKINPOhDr8vMoN/vVbOxSZ+rsYvCBXbF+WaVLA0F4xNLBQLYfsRmQrIYUcpfsBBpcfvzv2z7J+sE9w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-26_10:07:12 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-26T12:08:11.352 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa; will attempt to use it 2024-02-26T12:08:11.352 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks 2024-02-26T12:08:11.352 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-26T12:08:11.354 INFO:teuthology.task.internal:Checking packages... 2024-02-26T12:08:11.376 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6085b91fefeb74bf4310344a87d81d3217ef7893' 2024-02-26T12:08:11.376 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-26T12:08:11.376 INFO:teuthology.packaging:ref: None 2024-02-26T12:08:11.376 INFO:teuthology.packaging:tag: None 2024-02-26T12:08:11.376 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240226.064629 2024-02-26T12:08:11.376 INFO:teuthology.packaging:sha1: 6085b91fefeb74bf4310344a87d81d3217ef7893 2024-02-26T12:08:11.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240226.064629 2024-02-26T12:08:11.601 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1686.g6085b91f 2024-02-26T12:08:11.602 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-26T12:08:11.609 INFO:teuthology.task.internal:no buildpackages task found 2024-02-26T12:08:11.609 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-26T12:08:11.714 INFO:teuthology.task.internal:Saving configuration 2024-02-26T12:08:11.730 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-26T12:08:11.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-26T12:08:11.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-26 12:02:44.990607', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgzMb4SBKi8jhHofJlLFfmtu836Acx1Nmgnsi5e34UU9FNLewFT06lf/7kXOXGo6XbXAkGBYBbeyslye0Ym2ro='} 2024-02-26T12:08:11.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-26 12:02:44.992549', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCag7Cl00dKINPOhDr8vMoN/vVbOxSZ+rsYvCBXbF+WaVLA0F4xNLBQLYfsRmQrIYUcpfsBBpcfvzv2z7J+sE9w='} 2024-02-26T12:08:11.784 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-26T12:08:11.790 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-02-26T12:08:11.790 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-02-26T12:08:11.790 INFO:teuthology.run_tasks:Running task console_log... 2024-02-26T12:08:11.865 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2884fc1160>, signals=[15]) 2024-02-26T12:08:11.866 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-26T12:08:11.872 INFO:teuthology.task.internal:Opening connections... 2024-02-26T12:08:11.872 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:08:11.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:08:11.975 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:08:11.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:08:12.061 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-26T12:08:12.068 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2024-02-26T12:08:12.085 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2024-02-26T12:08:12.085 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2024-02-26T12:08:12.142 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream" 2024-02-26T12:08:12.142 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9" 2024-02-26T12:08:12.142 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T12:08:12.143 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T12:08:12.144 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2024-02-26T12:08:12.173 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-02-26T12:08:12.191 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-02-26T12:08:12.191 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-02-26T12:08:12.248 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-26T12:08:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-26T12:08:12.249 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-02-26T12:08:12.273 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-26T12:08:12.281 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-26T12:08:12.287 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-26T12:08:12.287 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2024-02-26T12:08:12.289 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-02-26T12:08:12.305 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-26T12:08:12.311 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-26T12:08:12.311 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2024-02-26T12:08:12.346 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-02-26T12:08:12.448 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-26T12:08:12.502 INFO:teuthology.run_tasks:Running task kernel... 2024-02-26T12:08:12.517 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '7c0fbba6c508351b48a34af7de7b074eb29ad0f9'} 2024-02-26T12:08:12.517 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-02-26T12:08:12.517 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-02-26T12:08:12.517 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-26T12:08:12.518 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-26T12:08:12.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:08:12.534 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-02-26T12:08:12.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:08:12.535 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-02-26T12:08:12.590 INFO:teuthology.orchestra.run.smithi113.stdout:5.14.0-361.el9.x86_64 2024-02-26T12:08:12.590 INFO:teuthology.task.kernel:Running kernel on smithi113: 5.14.0-361.el9.x86_64 2024-02-26T12:08:12.591 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum install -y kernel 2024-02-26T12:08:12.592 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-361.el9.x86_64 2024-02-26T12:08:12.592 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-361.el9.x86_64 2024-02-26T12:08:12.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-02-26T12:08:15.012 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 10 MB/s | 8.1 MB 00:00 2024-02-26T12:08:15.014 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - AppStream 10 MB/s | 8.1 MB 00:00 2024-02-26T12:08:16.713 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.5 MB 00:00 2024-02-26T12:08:16.749 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.5 MB 00:00 2024-02-26T12:08:18.165 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-02-26T12:08:18.253 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-02-26T12:08:20.157 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-02-26T12:08:23.354 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 19 MB 00:03 2024-02-26T12:08:24.233 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.1 MB 00:00 2024-02-26T12:08:26.966 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 9.4 kB/s | 15 kB 00:01 2024-02-26T12:08:27.713 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-02-26T12:08:29.197 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2024-02-26T12:08:29.284 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2024-02-26T12:08:32.059 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2024-02-26T12:08:34.217 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-02-26T12:08:36.485 INFO:teuthology.orchestra.run.smithi113.stderr:Modular dependency problems: 2024-02-26T12:08:36.485 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:08:36.485 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 1: conflicting requests 2024-02-26T12:08:36.485 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 2: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 3: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 4: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 5: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 6: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 7: conflicting requests 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.486 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 8: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 9: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 10: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 11: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 12: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 13: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 14: conflicting requests 2024-02-26T12:08:36.487 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 15: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 16: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 17: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 18: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 19: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 20: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 21: conflicting requests 2024-02-26T12:08:36.488 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 22: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 23: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 24: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 25: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 26: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 27: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 28: conflicting requests 2024-02-26T12:08:36.489 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 29: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 30: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 31: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 32: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 33: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 34: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 35: conflicting requests 2024-02-26T12:08:36.490 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 36: conflicting requests 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 37: cannot install the best candidate for the job 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 38: conflicting requests 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.491 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 39: cannot install the best candidate for the job 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 40: cannot install the best candidate for the job 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.492 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 41: cannot install the best candidate for the job 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 42: cannot install the best candidate for the job 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 43: cannot install the best candidate for the job 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.493 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.494 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 44: cannot install the best candidate for the job 2024-02-26T12:08:36.494 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.494 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.494 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.494 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-26T12:08:36.861 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-26T12:08:36.861 INFO:teuthology.orchestra.run.smithi113.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-26T12:08:36.963 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout: Package Architecture Version Repository Size 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout:Installing: 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-26T12:08:36.968 INFO:teuthology.orchestra.run.smithi113.stdout:Installing dependencies: 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout:================================================================================ 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout:Install 4 Packages 2024-02-26T12:08:36.969 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:08:36.970 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 99 M 2024-02-26T12:08:36.970 INFO:teuthology.orchestra.run.smithi113.stdout:Installed size: 122 M 2024-02-26T12:08:36.970 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-02-26T12:08:37.165 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-02-26T12:08:37.668 INFO:teuthology.orchestra.run.smithi113.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 19 MB/s | 6.0 MB 00:00 2024-02-26T12:08:38.143 INFO:teuthology.orchestra.run.smithi113.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 26 MB/s | 21 MB 00:00 2024-02-26T12:08:39.218 INFO:teuthology.orchestra.run.smithi113.stdout:(3/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 21 MB/s | 39 MB 00:01 2024-02-26T12:08:39.431 INFO:teuthology.orchestra.run.smithi152.stderr:Modular dependency problems: 2024-02-26T12:08:39.431 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-26T12:08:39.431 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 1: conflicting requests 2024-02-26T12:08:39.431 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 2: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 3: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 4: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 5: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 6: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 7: conflicting requests 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.432 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 8: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 9: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 10: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 11: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 12: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 13: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 14: conflicting requests 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.433 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 15: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 16: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 17: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 18: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 19: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 20: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 21: conflicting requests 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.434 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 22: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 23: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 24: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 25: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 26: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 27: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 28: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 29: conflicting requests 2024-02-26T12:08:39.435 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 30: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 31: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 32: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 33: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 34: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 35: conflicting requests 2024-02-26T12:08:39.436 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 36: conflicting requests 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 37: cannot install the best candidate for the job 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 38: conflicting requests 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.437 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 39: cannot install the best candidate for the job 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 40: cannot install the best candidate for the job 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.438 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 41: cannot install the best candidate for the job 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 42: cannot install the best candidate for the job 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 43: cannot install the best candidate for the job 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.439 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 44: cannot install the best candidate for the job 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.440 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-26T12:08:39.668 INFO:teuthology.orchestra.run.smithi113.stdout:(4/4): kernel-modules-core-5.14.0-419.el9.x86_6 17 MB/s | 33 MB 00:01 2024-02-26T12:08:39.669 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-02-26T12:08:39.669 INFO:teuthology.orchestra.run.smithi113.stdout:Total 37 MB/s | 99 MB 00:02 2024-02-26T12:08:39.856 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-26T12:08:39.856 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-26T12:08:39.978 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-419.el9 baseos 6.0 M 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-02-26T12:08:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-419.el9 baseos 21 M 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-419.el9 baseos 39 M 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-419.el9 baseos 33 M 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-02-26T12:08:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:08:39.991 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 99 M 2024-02-26T12:08:39.991 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 122 M 2024-02-26T12:08:39.991 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-02-26T12:08:40.458 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 18 MB/s | 6.0 MB 00:00 2024-02-26T12:08:40.558 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-02-26T12:08:40.945 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-02-26T12:08:40.946 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-02-26T12:08:41.025 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-02-26T12:08:41.833 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 23 MB/s | 39 MB 00:01 2024-02-26T12:08:42.276 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-02-26T12:08:42.277 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-02-26T12:08:42.392 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-core-5.14.0-419.el9.x86_6 17 MB/s | 33 MB 00:01 2024-02-26T12:08:42.394 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-02-26T12:08:42.395 INFO:teuthology.orchestra.run.smithi152.stdout:Total 41 MB/s | 99 MB 00:02 2024-02-26T12:08:43.281 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-02-26T12:08:43.676 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-02-26T12:08:43.676 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-02-26T12:08:44.964 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-02-26T12:08:45.332 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-02-26T12:08:45.333 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-02-26T12:08:45.627 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-26T12:08:45.769 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:08:48.026 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-02-26T12:08:48.557 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:08:48.680 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-26T12:08:48.729 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:08:48.813 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:08:51.608 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:08:51.793 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:08:53.461 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:08:53.590 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:08:56.518 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:08:56.737 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:08:58.350 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:01.477 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:27.794 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:27.795 INFO:teuthology.orchestra.run.smithi113.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-26T12:09:27.795 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:09:27.881 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:28.351 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:28.351 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-26T12:09:28.352 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:09:28.352 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:09:28.799 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout:Installed: 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:09:28.800 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-02-26T12:09:29.333 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q kernel | sort -rV | head -n 1 2024-02-26T12:09:29.470 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:29.470 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-26T12:09:29.470 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-26T12:09:29.470 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-26T12:09:29.470 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-26T12:09:29.471 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-02-26T12:09:29.471 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi113.front.sepia.ceph.com, path=None, version=distro) 2024-02-26T12:09:29.471 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q kernel | sort -rV | head -n 1 2024-02-26T12:09:29.591 INFO:teuthology.orchestra.run.smithi113.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:29.592 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-26T12:09:29.592 DEBUG:teuthology.orchestra.run.smithi113:> sudo rpm -qi grub2-tools 2024-02-26T12:09:29.629 INFO:teuthology.orchestra.run.smithi113.stdout:Name : grub2-tools 2024-02-26T12:09:29.629 INFO:teuthology.orchestra.run.smithi113.stdout:Epoch : 1 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Version : 2.06 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Release : 68.el9 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Architecture: x86_64 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Group : Unspecified 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Size : 8264254 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:License : GPLv3+ 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Packager : builder@centos.org 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Vendor : CentOS 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Summary : Support tools for GRUB. 2024-02-26T12:09:29.630 INFO:teuthology.orchestra.run.smithi113.stdout:Description : 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout:hardware devices. 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:09:29.631 INFO:teuthology.orchestra.run.smithi113.stdout:This subpackage provides tools for support of all platforms. 2024-02-26T12:09:29.632 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-26T12:09:29.632 INFO:teuthology.task.kernel:Updating grub on smithi113 to boot 5.14.0-419.el9.x86_64 2024-02-26T12:09:29.632 DEBUG:teuthology.orchestra.run.smithi113:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-26T12:09:30.218 INFO:teuthology.orchestra.run.smithi113.stderr:Generating grub configuration file ... 2024-02-26T12:09:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:30.649 INFO:teuthology.orchestra.run.smithi152.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-26T12:09:30.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:09:30.735 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:31.168 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:31.169 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-26T12:09:31.169 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-26T12:09:31.169 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-26T12:09:31.568 INFO:teuthology.orchestra.run.smithi113.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-26T12:09:31.619 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-26T12:09:31.620 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:09:31.620 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-02-26T12:09:31.624 INFO:teuthology.orchestra.run.smithi113.stderr:done 2024-02-26T12:09:31.627 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2024-02-26T12:09:31.642 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.7L4FxBYHZS 2024-02-26T12:09:31.642 DEBUG:teuthology.orchestra.run.smithi113:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7L4FxBYHZS 2024-02-26T12:09:31.711 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.7L4FxBYHZS 2024-02-26T12:09:31.842 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.7L4FxBYHZS is 6KB 2024-02-26T12:09:31.891 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.7L4FxBYHZS 2024-02-26T12:09:31.904 DEBUG:teuthology.orchestra.run.smithi113:> sudo /bin/ls /boot/loader/entries || true 2024-02-26T12:09:31.975 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-26T12:09:31.975 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-26T12:09:31.975 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-26T12:09:31.975 INFO:teuthology.orchestra.run.smithi113.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-26T12:09:31.976 DEBUG:teuthology.orchestra.run.smithi113:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-26T12:09:32.133 DEBUG:teuthology.orchestra.run.smithi113:> sudo shutdown -r now 2024-02-26T12:09:32.153 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-02-26T12:09:32.295 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:32.295 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-26T12:09:32.295 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-26T12:09:32.296 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-26T12:09:32.296 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-26T12:09:32.296 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-02-26T12:09:32.296 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-02-26T12:09:32.296 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-02-26T12:09:32.416 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-26T12:09:32.416 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-26T12:09:32.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 68.el9 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-02-26T12:09:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8264254 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-26T12:09:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-26T12:09:32.452 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-26T12:09:32.452 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-02-26T12:09:32.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:09:32.452 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-02-26T12:09:32.453 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-26T12:09:32.453 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-419.el9.x86_64 2024-02-26T12:09:32.453 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-26T12:09:33.127 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-02-26T12:09:34.596 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-26T12:09:34.628 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-02-26T12:09:34.631 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-02-26T12:09:34.645 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.8KjPf2Eq5g 2024-02-26T12:09:34.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8KjPf2Eq5g 2024-02-26T12:09:34.714 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.8KjPf2Eq5g 2024-02-26T12:09:34.847 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.8KjPf2Eq5g is 6KB 2024-02-26T12:09:34.896 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.8KjPf2Eq5g 2024-02-26T12:09:34.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-02-26T12:09:34.977 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-26T12:09:34.977 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-26T12:09:34.977 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-26T12:09:34.977 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-26T12:09:34.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-26T12:09:35.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-02-26T12:10:02.162 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-26T12:10:02.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:10:02.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:10:05.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-02-26T12:10:05.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:10:05.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:10:36.732 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-26T12:10:39.804 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-02-26T12:10:45.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:10:45.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:10:48.796 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2024-02-26T12:10:48.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:10:48.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:11:00.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:11:00.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:11:07.196 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-02-26T12:11:19.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:11:19.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:11:19.616 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-02-26T12:11:20.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:11:20.109 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-419.el9.x86_64"... 2024-02-26T12:11:20.110 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-02-26T12:11:20.123 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-419.el9.x86_64 2024-02-26T12:11:20.124 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-26T12:11:20.124 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-26T12:11:20.124 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-26T12:11:21.125 DEBUG:teuthology.parallel:result is None 2024-02-26T12:11:32.699 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-02-26T12:11:33.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:11:33.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-419.el9.x86_64"... 2024-02-26T12:11:33.114 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2024-02-26T12:11:33.128 INFO:teuthology.orchestra.run.smithi113.stdout:5.14.0-419.el9.x86_64 2024-02-26T12:11:33.128 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-26T12:11:33.129 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-26T12:11:33.129 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-26T12:11:34.129 DEBUG:teuthology.parallel:result is None 2024-02-26T12:11:34.130 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-26T12:11:34.136 INFO:teuthology.task.internal:Creating test directory... 2024-02-26T12:11:34.136 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-26T12:11:34.139 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-26T12:11:34.159 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-26T12:11:34.173 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-26T12:11:34.179 INFO:teuthology.task.internal:Creating archive directory... 2024-02-26T12:11:34.179 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-26T12:11:34.197 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-26T12:11:34.239 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-26T12:11:34.245 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-26T12:11:34.245 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-26T12:11:34.272 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-26T12:11:34.352 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-26T12:11:34.386 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-26T12:11:34.415 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-26T12:11:34.449 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-26T12:11:34.451 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-26T12:11:34.458 INFO:teuthology.task.internal:Configuring sudo... 2024-02-26T12:11:34.458 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-26T12:11:34.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-26T12:11:34.503 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-26T12:11:34.545 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-26T12:11:34.545 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-26T12:11:34.548 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-26T12:11:34.570 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-26T12:11:34.661 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-26T12:11:34.732 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-26T12:11:34.783 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-26T12:11:34.821 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:11:34.821 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-26T12:11:34.886 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-26T12:11:34.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-26T12:11:34.990 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-26T12:11:35.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-26T12:11:35.080 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:11:35.080 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-26T12:11:35.150 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2024-02-26T12:11:35.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-02-26T12:11:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-26T12:11:35.315 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-26T12:11:35.868 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-26T12:11:35.876 INFO:teuthology.task.internal:Starting timer... 2024-02-26T12:11:35.876 INFO:teuthology.run_tasks:Running task pcp... 2024-02-26T12:11:35.886 INFO:teuthology.run_tasks:Running task selinux... 2024-02-26T12:11:35.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo service auditd rotate 2024-02-26T12:11:35.942 INFO:teuthology.orchestra.run.smithi113.stdout:Rotating logs: 2024-02-26T12:11:35.944 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-02-26T12:11:36.006 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-02-26T12:11:36.008 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-26T12:11:36.008 DEBUG:teuthology.orchestra.run.smithi113:> /usr/sbin/getenforce 2024-02-26T12:11:36.027 INFO:teuthology.orchestra.run.smithi113.stdout:Permissive 2024-02-26T12:11:36.028 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-02-26T12:11:36.052 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-02-26T12:11:36.053 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi113.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-02-26T12:11:36.053 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-26T12:11:36.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:11:36.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-26T12:11:36.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:11:36.121 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-26T12:11:36.121 DEBUG:teuthology.orchestra.run.smithi113:> sudo /usr/sbin/setenforce permissive 2024-02-26T12:11:36.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-02-26T12:11:36.205 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-26T12:11:36.215 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-26T12:11:36.232 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-26T12:11:36.233 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi113.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-26T12:16:16.957 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi113.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-02-26T12:16:16.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:16:16.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:16:17.051 DEBUG:teuthology.orchestra.run.smithi113:> true 2024-02-26T12:16:17.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2024-02-26T12:16:17.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:16:17.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-26T12:16:17.175 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-02-26T12:16:17.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-02-26T12:16:17.256 INFO:teuthology.run_tasks:Running task clock... 2024-02-26T12:16:17.267 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-26T12:16:17.267 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-26T12:16:17.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-26T12:16:17.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-26T12:16:17.270 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-26T12:16:17.298 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-26T12:16:17.315 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-26T12:16:17.327 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-26T12:16:17.343 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-26T12:16:17.344 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: ntpd: command not found 2024-02-26T12:16:17.358 INFO:teuthology.orchestra.run.smithi113.stdout:506 Cannot talk to daemon 2024-02-26T12:16:17.373 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-02-26T12:16:17.374 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-26T12:16:17.387 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-02-26T12:16:17.390 INFO:teuthology.orchestra.run.smithi113.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-26T12:16:17.403 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-26T12:16:17.420 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-26T12:16:17.446 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.449 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.472 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.475 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:16:17.476 INFO:teuthology.run_tasks:Running task install... 2024-02-26T12:16:17.485 DEBUG:teuthology.task.install:project ceph 2024-02-26T12:16:17.485 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'}} 2024-02-26T12:16:17.485 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'} 2024-02-26T12:16:17.485 INFO:teuthology.task.install:Using flavor: default 2024-02-26T12:16:17.491 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-26T12:16:17.491 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-26T12:16:17.492 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893', 'tag': None, 'wait_for_package': False} 2024-02-26T12:16:17.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6085b91fefeb74bf4310344a87d81d3217ef7893 2024-02-26T12:16:17.494 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893', 'tag': None, 'wait_for_package': False} 2024-02-26T12:16:17.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6085b91fefeb74bf4310344a87d81d3217ef7893 2024-02-26T12:16:17.750 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/ 2024-02-26T12:16:17.750 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1686.g6085b91f 2024-02-26T12:16:17.752 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/ 2024-02-26T12:16:17.752 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1686.g6085b91f 2024-02-26T12:16:17.878 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-26T12:16:17.878 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:16:17.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-26T12:16:17.907 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-26T12:16:17.907 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6085b91fefeb74bf4310344a87d81d3217ef7893/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-26T12:16:17.972 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240226.064629/6085b91fefeb74bf4310344a87d81d3217ef7893/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-26T12:16:17.972 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:16:17.972 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-26T12:16:17.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-26T12:16:18.001 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-26T12:16:18.001 DEBUG:teuthology.orchestra.run.smithi113:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6085b91fefeb74bf4310344a87d81d3217ef7893/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-26T12:16:18.055 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-26T12:16:18.070 DEBUG:teuthology.orchestra.run.smithi113:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-26T12:16:18.125 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-02-26T12:16:18.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-02-26T12:16:18.150 DEBUG:teuthology.orchestra.run.smithi113:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-26T12:16:18.216 INFO:teuthology.orchestra.run.smithi113.stdout:check_obsoletes = 1 2024-02-26T12:16:18.218 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum clean all 2024-02-26T12:16:18.367 INFO:teuthology.orchestra.run.smithi152.stdout:74 files removed 2024-02-26T12:16:18.394 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-26T12:16:18.460 INFO:teuthology.orchestra.run.smithi113.stdout:74 files removed 2024-02-26T12:16:18.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-26T12:16:19.156 INFO:teuthology.orchestra.run.smithi113.stdout:ceph packages for x86_64 232 kB/s | 82 kB 00:00 2024-02-26T12:16:19.176 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 177 kB/s | 82 kB 00:00 2024-02-26T12:16:19.565 INFO:teuthology.orchestra.run.smithi113.stdout:ceph noarch packages 28 kB/s | 10 kB 00:00 2024-02-26T12:16:19.594 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-02-26T12:16:19.928 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-02-26T12:16:20.065 INFO:teuthology.orchestra.run.smithi113.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-02-26T12:16:20.540 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-02-26T12:16:20.718 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-02-26T12:16:22.585 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS-9 - BaseOS 4.7 MB/s | 2.5 MB 00:00 2024-02-26T12:16:22.748 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.5 MB 00:00 2024-02-26T12:16:24.469 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-02-26T12:16:24.722 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-02-26T12:16:26.806 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-02-26T12:16:26.971 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-02-26T12:16:32.985 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.1 MB 00:02 2024-02-26T12:16:34.860 INFO:teuthology.orchestra.run.smithi113.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-02-26T12:16:37.373 INFO:teuthology.orchestra.run.smithi113.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 20 MB 00:02 2024-02-26T12:16:41.006 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 582 kB/s | 6.1 MB 00:10 2024-02-26T12:16:42.395 INFO:teuthology.orchestra.run.smithi113.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-26T12:16:42.690 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-26T12:16:44.400 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-02-26T12:16:44.982 INFO:teuthology.orchestra.run.smithi113.stderr:Modular dependency problems: 2024-02-26T12:16:44.982 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:16:44.982 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 1: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 2: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 3: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 4: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 5: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 6: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 7: conflicting requests 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.983 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 8: conflicting requests 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 9: conflicting requests 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 10: conflicting requests 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 11: conflicting requests 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 12: conflicting requests 2024-02-26T12:16:44.984 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 13: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 14: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 15: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 16: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 17: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 18: conflicting requests 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.985 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 19: conflicting requests 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 20: conflicting requests 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 21: conflicting requests 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 22: conflicting requests 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 23: conflicting requests 2024-02-26T12:16:44.986 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 24: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 25: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 26: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 27: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 28: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 29: conflicting requests 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.987 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 30: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 31: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 32: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 33: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 34: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 35: conflicting requests 2024-02-26T12:16:44.988 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 36: conflicting requests 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 37: cannot install the best candidate for the job 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.989 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 38: conflicting requests 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 39: cannot install the best candidate for the job 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 40: cannot install the best candidate for the job 2024-02-26T12:16:44.990 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 41: cannot install the best candidate for the job 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 42: cannot install the best candidate for the job 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.991 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 43: cannot install the best candidate for the job 2024-02-26T12:16:44.992 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.992 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 44: cannot install the best candidate for the job 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-26T12:16:44.993 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-26T12:16:45.451 INFO:teuthology.orchestra.run.smithi113.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-26T12:16:45.452 INFO:teuthology.orchestra.run.smithi113.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-26T12:16:45.466 INFO:teuthology.orchestra.run.smithi113.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-26T12:16:45.466 INFO:teuthology.orchestra.run.smithi113.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-26T12:16:45.467 INFO:teuthology.orchestra.run.smithi113.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-26T12:16:45.469 INFO:teuthology.orchestra.run.smithi113.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-26T12:16:45.471 INFO:teuthology.orchestra.run.smithi113.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-26T12:16:45.474 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-26T12:16:45.475 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-26T12:16:45.562 INFO:teuthology.orchestra.run.smithi113.stdout:Dependencies resolved. 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout:========================================================================================= 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: Package Arch Version Repository Size 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout:========================================================================================= 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout:Installing: 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 6.6 k 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 5.3 M 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 888 k 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 145 k 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 1.5 M 2024-02-26T12:16:45.578 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 138 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 1.8 M 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 7.4 M 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 49 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 9.8 M 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 47 M 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 264 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 748 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 220 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 27 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 18 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-26T12:16:45.579 INFO:teuthology.orchestra.run.smithi113.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 31 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 744 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 127 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 162 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 320 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 298 k 2024-02-26T12:16:45.580 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 100 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 85 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.1 M 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 170 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrading: 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-26T12:16:45.581 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: librados2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.4 M 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.1 M 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout:Installing dependencies: 2024-02-26T12:16:45.582 INFO:teuthology.orchestra.run.smithi113.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 20 M 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 31 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 2.1 M 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 248 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 4.7 M 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 17 M 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 15 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 25 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-26T12:16:45.583 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 163 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 501 k 2024-02-26T12:16:45.584 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 5.1 M 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-26T12:16:45.585 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 45 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 131 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-26T12:16:45.586 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-26T12:16:45.587 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-26T12:16:45.588 INFO:teuthology.orchestra.run.smithi113.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-26T12:16:45.589 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-26T12:16:45.590 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout:Installing weak dependencies: 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction Summary 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout:========================================================================================= 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout:Install 150 Packages 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout:Upgrade 16 Packages 2024-02-26T12:16:45.591 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:16:45.592 INFO:teuthology.orchestra.run.smithi113.stdout:Total download size: 222 M 2024-02-26T12:16:45.592 INFO:teuthology.orchestra.run.smithi113.stdout:Downloading Packages: 2024-02-26T12:16:47.229 INFO:teuthology.orchestra.run.smithi113.stdout:(1/166): ceph-19.0.0-1686.g6085b91f.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-02-26T12:16:47.954 INFO:teuthology.orchestra.run.smithi113.stdout:(2/166): ceph-fuse-19.0.0-1686.g6085b91f.el9.x8 1.2 MB/s | 888 kB 00:00 2024-02-26T12:16:48.146 INFO:teuthology.orchestra.run.smithi113.stdout:(3/166): ceph-immutable-object-cache-19.0.0-168 758 kB/s | 145 kB 00:00 2024-02-26T12:16:48.355 INFO:teuthology.orchestra.run.smithi113.stdout:(4/166): ceph-common-19.0.0-1686.g6085b91f.el9. 13 MB/s | 20 MB 00:01 2024-02-26T12:16:48.471 INFO:teuthology.orchestra.run.smithi113.stdout:(5/166): ceph-mgr-19.0.0-1686.g6085b91f.el9.x86 13 MB/s | 1.5 MB 00:00 2024-02-26T12:16:48.755 INFO:teuthology.orchestra.run.smithi113.stdout:(6/166): ceph-mon-19.0.0-1686.g6085b91f.el9.x86 17 MB/s | 4.7 MB 00:00 2024-02-26T12:16:49.072 INFO:teuthology.orchestra.run.smithi113.stdout:(7/166): ceph-mds-19.0.0-1686.g6085b91f.el9.x86 2.3 MB/s | 2.1 MB 00:00 2024-02-26T12:16:49.447 INFO:teuthology.orchestra.run.smithi113.stdout:(8/166): ceph-base-19.0.0-1686.g6085b91f.el9.x8 2.1 MB/s | 5.3 MB 00:02 2024-02-26T12:16:49.450 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-02-26T12:16:49.639 INFO:teuthology.orchestra.run.smithi113.stdout:(9/166): ceph-osd-19.0.0-1686.g6085b91f.el9.x86 19 MB/s | 17 MB 00:00 2024-02-26T12:16:49.656 INFO:teuthology.orchestra.run.smithi113.stdout:(10/166): ceph-selinux-19.0.0-1686.g6085b91f.el 121 kB/s | 25 kB 00:00 2024-02-26T12:16:49.765 INFO:teuthology.orchestra.run.smithi113.stdout:(11/166): cephfs-mirror-19.0.0-1686.g6085b91f.e 2.0 MB/s | 220 kB 00:00 2024-02-26T12:16:49.865 INFO:teuthology.orchestra.run.smithi113.stdout:(12/166): cephfs-shell-19.0.0-1686.g6085b91f.el 271 kB/s | 27 kB 00:00 2024-02-26T12:16:49.965 INFO:teuthology.orchestra.run.smithi113.stdout:(13/166): libcephfs-devel-19.0.0-1686.g6085b91f 312 kB/s | 31 kB 00:00 2024-02-26T12:16:50.266 INFO:teuthology.orchestra.run.smithi113.stdout:(14/166): libcephfs2-19.0.0-1686.g6085b91f.el9. 2.4 MB/s | 744 kB 00:00 2024-02-26T12:16:50.366 INFO:teuthology.orchestra.run.smithi113.stdout:(15/166): libcephsqlite-19.0.0-1686.g6085b91f.e 1.6 MB/s | 163 kB 00:00 2024-02-26T12:16:50.458 INFO:teuthology.orchestra.run.smithi113.stdout:(16/166): librados-devel-19.0.0-1686.g6085b91f. 1.4 MB/s | 127 kB 00:00 2024-02-26T12:16:50.633 INFO:teuthology.orchestra.run.smithi113.stdout:(17/166): libradosstriper1-19.0.0-1686.g6085b91 2.8 MB/s | 501 kB 00:00 2024-02-26T12:16:50.975 INFO:teuthology.orchestra.run.smithi113.stdout:(18/166): ceph-radosgw-19.0.0-1686.g6085b91f.el 5.1 MB/s | 9.8 MB 00:01 2024-02-26T12:16:51.075 INFO:teuthology.orchestra.run.smithi113.stdout:(19/166): python3-ceph-argparse-19.0.0-1686.g60 453 kB/s | 45 kB 00:00 2024-02-26T12:16:51.176 INFO:teuthology.orchestra.run.smithi113.stdout:(20/166): python3-ceph-common-19.0.0-1686.g6085 1.3 MB/s | 131 kB 00:00 2024-02-26T12:16:51.268 INFO:teuthology.orchestra.run.smithi113.stdout:(21/166): python3-cephfs-19.0.0-1686.g6085b91f. 1.7 MB/s | 162 kB 00:00 2024-02-26T12:16:51.385 INFO:teuthology.orchestra.run.smithi113.stdout:(22/166): python3-rados-19.0.0-1686.g6085b91f.e 2.7 MB/s | 320 kB 00:00 2024-02-26T12:16:51.502 INFO:teuthology.orchestra.run.smithi113.stdout:(23/166): python3-rbd-19.0.0-1686.g6085b91f.el9 2.5 MB/s | 298 kB 00:00 2024-02-26T12:16:51.569 INFO:teuthology.orchestra.run.smithi113.stdout:(24/166): librgw2-19.0.0-1686.g6085b91f.el9.x86 5.5 MB/s | 5.1 MB 00:00 2024-02-26T12:16:51.594 INFO:teuthology.orchestra.run.smithi113.stdout:(25/166): python3-rgw-19.0.0-1686.g6085b91f.el9 1.1 MB/s | 100 kB 00:00 2024-02-26T12:16:51.661 INFO:teuthology.orchestra.run.smithi113.stdout:(26/166): rbd-fuse-19.0.0-1686.g6085b91f.el9.x8 931 kB/s | 85 kB 00:00 2024-02-26T12:16:51.770 INFO:teuthology.orchestra.run.smithi113.stdout:(27/166): rbd-nbd-19.0.0-1686.g6085b91f.el9.x86 1.5 MB/s | 170 kB 00:00 2024-02-26T12:16:51.870 INFO:teuthology.orchestra.run.smithi113.stdout:(28/166): ceph-grafana-dashboards-19.0.0-1686.g 314 kB/s | 31 kB 00:00 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr:Modular dependency problems: 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 1: conflicting requests 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 2: conflicting requests 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.040 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 3: conflicting requests 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 4: conflicting requests 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 5: conflicting requests 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 6: conflicting requests 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 7: conflicting requests 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.041 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 8: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 9: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 10: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 11: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 12: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 13: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 14: conflicting requests 2024-02-26T12:16:52.042 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 15: conflicting requests 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 16: conflicting requests 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 17: conflicting requests 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 18: conflicting requests 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 19: conflicting requests 2024-02-26T12:16:52.043 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 20: conflicting requests 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 21: conflicting requests 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 22: conflicting requests 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 23: conflicting requests 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 24: conflicting requests 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.044 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 25: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 26: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 27: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 28: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 29: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 30: conflicting requests 2024-02-26T12:16:52.045 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 31: conflicting requests 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 32: conflicting requests 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 33: conflicting requests 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 34: conflicting requests 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 35: conflicting requests 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.046 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 36: conflicting requests 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 37: cannot install the best candidate for the job 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 38: conflicting requests 2024-02-26T12:16:52.047 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 39: cannot install the best candidate for the job 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.048 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 40: cannot install the best candidate for the job 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 41: cannot install the best candidate for the job 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.049 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 42: cannot install the best candidate for the job 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 43: cannot install the best candidate for the job 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: Problem 44: cannot install the best candidate for the job 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.050 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.051 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.051 INFO:teuthology.orchestra.run.smithi152.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-26T12:16:52.370 INFO:teuthology.orchestra.run.smithi113.stdout:(29/166): ceph-test-19.0.0-1686.g6085b91f.el9.x 17 MB/s | 47 MB 00:02 2024-02-26T12:16:52.395 INFO:teuthology.orchestra.run.smithi113.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1686.g6085b91 263 kB/s | 138 kB 00:00 2024-02-26T12:16:52.462 INFO:teuthology.orchestra.run.smithi113.stdout:(31/166): rbd-mirror-19.0.0-1686.g6085b91f.el9. 3.6 MB/s | 3.1 MB 00:00 2024-02-26T12:16:52.505 INFO:teuthology.orchestra.run.smithi113.stdout:(32/166): ceph-mgr-dashboard-19.0.0-1686.g6085b 13 MB/s | 1.8 MB 00:00 2024-02-26T12:16:52.546 INFO:teuthology.orchestra.run.smithi113.stdout:(33/166): ceph-mgr-modules-core-19.0.0-1686.g60 2.9 MB/s | 248 kB 00:00 2024-02-26T12:16:52.547 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-26T12:16:52.548 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-26T12:16:52.562 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-26T12:16:52.563 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-26T12:16:52.563 INFO:teuthology.orchestra.run.smithi113.stdout:(34/166): ceph-mgr-rook-19.0.0-1686.g6085b91f.e 844 kB/s | 49 kB 00:00 2024-02-26T12:16:52.564 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-26T12:16:52.565 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-26T12:16:52.567 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-26T12:16:52.570 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-26T12:16:52.571 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-26T12:16:52.614 INFO:teuthology.orchestra.run.smithi113.stdout:(35/166): ceph-volume-19.0.0-1686.g6085b91f.el9 5.2 MB/s | 264 kB 00:00 2024-02-26T12:16:52.631 INFO:teuthology.orchestra.run.smithi113.stdout:(36/166): ceph-prometheus-alerts-19.0.0-1686.g6 183 kB/s | 15 kB 00:00 2024-02-26T12:16:52.660 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-02-26T12:16:52.677 INFO:teuthology.orchestra.run.smithi152.stdout:========================================================================================= 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout:========================================================================================= 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 6.6 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 5.3 M 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 888 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 145 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 1.5 M 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 138 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 1.8 M 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 7.4 M 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 49 k 2024-02-26T12:16:52.678 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 9.8 M 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 47 M 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 264 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 748 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 220 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 27 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 18 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 31 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 744 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 127 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-26T12:16:52.679 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 162 k 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 320 k 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 298 k 2024-02-26T12:16:52.680 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 100 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 85 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.1 M 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 170 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-26T12:16:52.681 INFO:teuthology.orchestra.run.smithi152.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.4 M 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 3.1 M 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-26T12:16:52.682 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 20 M 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 31 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 2.1 M 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 248 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 4.7 M 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 17 M 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1686.g6085b91f.el9 ceph-noarch 15 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 25 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-26T12:16:52.683 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 163 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-26T12:16:52.684 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 501 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 5.1 M 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-26T12:16:52.685 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 45 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.0.0-1686.g6085b91f.el9 ceph 131 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-26T12:16:52.686 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-26T12:16:52.687 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-26T12:16:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-26T12:16:52.689 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-26T12:16:52.690 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-26T12:16:52.691 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-26T12:16:52.691 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-26T12:16:52.691 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-26T12:16:52.691 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout:========================================================================================= 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout:Install 150 Packages 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 16 Packages 2024-02-26T12:16:52.692 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:16:52.693 INFO:teuthology.orchestra.run.smithi113.stdout:(37/166): cephfs-top-19.0.0-1686.g6085b91f.el9. 367 kB/s | 18 kB 00:00 2024-02-26T12:16:52.693 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 222 M 2024-02-26T12:16:52.693 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-02-26T12:16:52.731 INFO:teuthology.orchestra.run.smithi113.stdout:(38/166): cephadm-19.0.0-1686.g6085b91f.el9.noa 6.2 MB/s | 748 kB 00:00 2024-02-26T12:16:52.840 INFO:teuthology.orchestra.run.smithi113.stdout:(39/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 111 kB/s | 18 kB 00:00 2024-02-26T12:16:53.123 INFO:teuthology.orchestra.run.smithi113.stdout:(40/166): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-02-26T12:16:53.207 INFO:teuthology.orchestra.run.smithi113.stdout:(41/166): fuse-2.9.9-15.el9.x86_64.rpm 169 kB/s | 80 kB 00:00 2024-02-26T12:16:53.432 INFO:teuthology.orchestra.run.smithi113.stdout:(42/166): jq-1.6-16.el9.x86_64.rpm 316 kB/s | 187 kB 00:00 2024-02-26T12:16:53.458 INFO:teuthology.orchestra.run.smithi113.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 780 kB/s | 195 kB 00:00 2024-02-26T12:16:53.683 INFO:teuthology.orchestra.run.smithi113.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 871 kB/s | 218 kB 00:00 2024-02-26T12:16:53.708 INFO:teuthology.orchestra.run.smithi113.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-02-26T12:16:53.842 INFO:teuthology.orchestra.run.smithi113.stdout:(46/166): python3-ply-3.11-14.el9.noarch.rpm 799 kB/s | 106 kB 00:00 2024-02-26T12:16:53.975 INFO:teuthology.orchestra.run.smithi113.stdout:(47/166): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-02-26T12:16:54.134 INFO:teuthology.orchestra.run.smithi113.stdout:(48/166): libgfortran-11.4.1-3.el9.x86_64.rpm 795 kB/s | 803 kB 00:01 2024-02-26T12:16:54.159 INFO:teuthology.orchestra.run.smithi113.stdout:(49/166): python3-requests-2.25.1-8.el9.noarch. 679 kB/s | 125 kB 00:00 2024-02-26T12:16:54.202 INFO:teuthology.orchestra.run.smithi113.stdout:(50/166): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-02-26T12:16:54.260 INFO:teuthology.orchestra.run.smithi113.stdout:(51/166): python3-urllib3-1.26.5-5.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-02-26T12:16:54.409 INFO:teuthology.orchestra.run.smithi152.stdout:(1/166): ceph-19.0.0-1686.g6085b91f.el9.x86_64. 10 kB/s | 6.6 kB 00:00 2024-02-26T12:16:54.561 INFO:teuthology.orchestra.run.smithi113.stdout:(52/166): boost-program-options-1.75.0-8.el9.x8 356 kB/s | 107 kB 00:00 2024-02-26T12:16:54.643 INFO:teuthology.orchestra.run.smithi152.stdout:(2/166): ceph-base-19.0.0-1686.g6085b91f.el9.x8 6.1 MB/s | 5.3 MB 00:00 2024-02-26T12:16:54.644 INFO:teuthology.orchestra.run.smithi113.stdout:(53/166): elfutils-libelf-devel-0.190-2.el9.x86 260 kB/s | 21 kB 00:00 2024-02-26T12:16:54.678 INFO:teuthology.orchestra.run.smithi113.stdout:(54/166): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 689 kB 00:00 2024-02-26T12:16:54.702 INFO:teuthology.orchestra.run.smithi152.stdout:(3/166): ceph-immutable-object-cache-19.0.0-168 2.4 MB/s | 145 kB 00:00 2024-02-26T12:16:54.769 INFO:teuthology.orchestra.run.smithi113.stdout:(55/166): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-02-26T12:16:54.795 INFO:teuthology.orchestra.run.smithi113.stdout:(56/166): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-02-26T12:16:54.820 INFO:teuthology.orchestra.run.smithi113.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-02-26T12:16:54.879 INFO:teuthology.orchestra.run.smithi113.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-02-26T12:16:54.946 INFO:teuthology.orchestra.run.smithi113.stdout:(59/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-02-26T12:16:54.960 INFO:teuthology.orchestra.run.smithi152.stdout:(4/166): ceph-mds-19.0.0-1686.g6085b91f.el9.x86 8.2 MB/s | 2.1 MB 00:00 2024-02-26T12:16:54.963 INFO:teuthology.orchestra.run.smithi113.stdout:(60/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-02-26T12:16:55.127 INFO:teuthology.orchestra.run.smithi152.stdout:(5/166): ceph-mgr-19.0.0-1686.g6085b91f.el9.x86 8.9 MB/s | 1.5 MB 00:00 2024-02-26T12:16:55.164 INFO:teuthology.orchestra.run.smithi113.stdout:(61/166): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-02-26T12:16:55.476 INFO:teuthology.orchestra.run.smithi152.stdout:(6/166): ceph-fuse-19.0.0-1686.g6085b91f.el9.x8 1.1 MB/s | 888 kB 00:00 2024-02-26T12:16:55.477 INFO:teuthology.orchestra.run.smithi113.stdout:(62/166): libtool-2.4.6-45.el9.x86_64.rpm 1.7 MB/s | 582 kB 00:00 2024-02-26T12:16:55.477 INFO:teuthology.orchestra.run.smithi113.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 170 kB/s | 26 kB 00:00 2024-02-26T12:16:55.477 INFO:teuthology.orchestra.run.smithi113.stdout:(64/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-02-26T12:16:55.477 INFO:teuthology.orchestra.run.smithi113.stdout:(65/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 333 kB/s | 47 kB 00:00 2024-02-26T12:16:55.520 INFO:teuthology.orchestra.run.smithi152.stdout:(7/166): ceph-common-19.0.0-1686.g6085b91f.el9. 11 MB/s | 20 MB 00:01 2024-02-26T12:16:55.522 INFO:teuthology.orchestra.run.smithi113.stdout:(66/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-02-26T12:16:55.540 INFO:teuthology.orchestra.run.smithi113.stdout:(67/166): openblas-0.3.21-2.el9.x86_64.rpm 352 kB/s | 35 kB 00:00 2024-02-26T12:16:55.565 INFO:teuthology.orchestra.run.smithi113.stdout:(68/166): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-02-26T12:16:55.587 INFO:teuthology.orchestra.run.smithi152.stdout:(8/166): ceph-mon-19.0.0-1686.g6085b91f.el9.x86 10 MB/s | 4.7 MB 00:00 2024-02-26T12:16:55.628 INFO:teuthology.orchestra.run.smithi152.stdout:(9/166): ceph-selinux-19.0.0-1686.g6085b91f.el9 608 kB/s | 25 kB 00:00 2024-02-26T12:16:55.984 INFO:teuthology.orchestra.run.smithi113.stdout:(69/166): postgresql-13.11-1.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-02-26T12:16:56.149 INFO:teuthology.orchestra.run.smithi113.stdout:(70/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 6.8 MB/s | 4.1 MB 00:00 2024-02-26T12:16:56.182 INFO:teuthology.orchestra.run.smithi113.stdout:(71/166): postgresql-contrib-13.11-1.el9.x86_64 4.4 MB/s | 905 kB 00:00 2024-02-26T12:16:56.233 INFO:teuthology.orchestra.run.smithi113.stdout:(72/166): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 135 kB 00:00 2024-02-26T12:16:56.400 INFO:teuthology.orchestra.run.smithi113.stdout:(73/166): openblas-openmp-0.3.21-2.el9.x86_64.r 5.4 MB/s | 4.7 MB 00:00 2024-02-26T12:16:56.434 INFO:teuthology.orchestra.run.smithi113.stdout:(74/166): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-02-26T12:16:56.475 INFO:teuthology.orchestra.run.smithi113.stdout:(75/166): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-02-26T12:16:56.584 INFO:teuthology.orchestra.run.smithi113.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-02-26T12:16:56.693 INFO:teuthology.orchestra.run.smithi113.stdout:(77/166): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-02-26T12:16:56.712 INFO:teuthology.orchestra.run.smithi152.stdout:(10/166): ceph-radosgw-19.0.0-1686.g6085b91f.el 8.2 MB/s | 9.8 MB 00:01 2024-02-26T12:16:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:(11/166): cephfs-mirror-19.0.0-1686.g6085b91f.e 4.3 MB/s | 220 kB 00:00 2024-02-26T12:16:56.784 INFO:teuthology.orchestra.run.smithi113.stdout:(78/166): postgresql-server-13.11-1.el9.x86_64. 9.6 MB/s | 5.7 MB 00:00 2024-02-26T12:16:56.830 INFO:teuthology.orchestra.run.smithi152.stdout:(12/166): cephfs-shell-19.0.0-1686.g6085b91f.el 407 kB/s | 27 kB 00:00 2024-02-26T12:16:56.835 INFO:teuthology.orchestra.run.smithi113.stdout:(79/166): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-02-26T12:16:56.860 INFO:teuthology.orchestra.run.smithi113.stdout:(80/166): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-02-26T12:16:56.905 INFO:teuthology.orchestra.run.smithi152.stdout:(13/166): libcephfs-devel-19.0.0-1686.g6085b91f 416 kB/s | 31 kB 00:00 2024-02-26T12:16:56.935 INFO:teuthology.orchestra.run.smithi113.stdout:(81/166): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-02-26T12:16:56.961 INFO:teuthology.orchestra.run.smithi113.stdout:(82/166): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-02-26T12:16:56.986 INFO:teuthology.orchestra.run.smithi113.stdout:(83/166): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-02-26T12:16:57.036 INFO:teuthology.orchestra.run.smithi113.stdout:(84/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-02-26T12:16:57.055 INFO:teuthology.orchestra.run.smithi152.stdout:(14/166): libcephfs2-19.0.0-1686.g6085b91f.el9. 4.9 MB/s | 744 kB 00:00 2024-02-26T12:16:57.062 INFO:teuthology.orchestra.run.smithi113.stdout:(85/166): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-02-26T12:16:57.112 INFO:teuthology.orchestra.run.smithi113.stdout:(86/166): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-02-26T12:16:57.129 INFO:teuthology.orchestra.run.smithi113.stdout:(87/166): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-02-26T12:16:57.130 INFO:teuthology.orchestra.run.smithi152.stdout:(15/166): libcephsqlite-19.0.0-1686.g6085b91f.e 2.1 MB/s | 163 kB 00:00 2024-02-26T12:16:57.188 INFO:teuthology.orchestra.run.smithi113.stdout:(88/166): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-02-26T12:16:57.208 INFO:teuthology.orchestra.run.smithi152.stdout:(16/166): librados-devel-19.0.0-1686.g6085b91f. 1.7 MB/s | 127 kB 00:00 2024-02-26T12:16:57.213 INFO:teuthology.orchestra.run.smithi113.stdout:(89/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-02-26T12:16:57.263 INFO:teuthology.orchestra.run.smithi113.stdout:(90/166): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-02-26T12:16:57.280 INFO:teuthology.orchestra.run.smithi113.stdout:(91/166): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-02-26T12:16:57.297 INFO:teuthology.orchestra.run.smithi152.stdout:(17/166): libradosstriper1-19.0.0-1686.g6085b91 5.4 MB/s | 501 kB 00:00 2024-02-26T12:16:57.322 INFO:teuthology.orchestra.run.smithi113.stdout:(92/166): python3-requests-oauthlib-1.3.0-12.el 920 kB/s | 54 kB 00:00 2024-02-26T12:16:57.389 INFO:teuthology.orchestra.run.smithi113.stdout:(93/166): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-02-26T12:16:57.456 INFO:teuthology.orchestra.run.smithi113.stdout:(94/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 663 kB/s | 44 kB 00:00 2024-02-26T12:16:57.548 INFO:teuthology.orchestra.run.smithi113.stdout:(95/166): qatlib-23.11.0-1.el9.x86_64.rpm 2.3 MB/s | 216 kB 00:00 2024-02-26T12:16:57.657 INFO:teuthology.orchestra.run.smithi113.stdout:(96/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.1 MB/s | 5.1 MB 00:00 2024-02-26T12:16:57.673 INFO:teuthology.orchestra.run.smithi113.stdout:(97/166): qatlib-service-23.11.0-1.el9.x86_64.r 278 kB/s | 35 kB 00:00 2024-02-26T12:16:57.757 INFO:teuthology.orchestra.run.smithi113.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 445 kB/s | 44 kB 00:00 2024-02-26T12:16:57.791 INFO:teuthology.orchestra.run.smithi113.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-02-26T12:16:57.874 INFO:teuthology.orchestra.run.smithi113.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-02-26T12:16:57.916 INFO:teuthology.orchestra.run.smithi113.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 748 kB/s | 94 kB 00:00 2024-02-26T12:16:57.975 INFO:teuthology.orchestra.run.smithi113.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-02-26T12:16:58.008 INFO:teuthology.orchestra.run.smithi113.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-02-26T12:16:58.039 INFO:teuthology.orchestra.run.smithi152.stdout:(18/166): librgw2-19.0.0-1686.g6085b91f.el9.x86 6.9 MB/s | 5.1 MB 00:00 2024-02-26T12:16:58.228 INFO:teuthology.orchestra.run.smithi113.stdout:(104/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-02-26T12:16:58.243 INFO:teuthology.orchestra.run.smithi113.stdout:(105/166): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-02-26T12:16:58.476 INFO:teuthology.orchestra.run.smithi113.stdout:(106/166): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-02-26T12:16:58.498 INFO:teuthology.orchestra.run.smithi152.stdout:(19/166): ceph-test-19.0.0-1686.g6085b91f.el9.x 17 MB/s | 47 MB 00:02 2024-02-26T12:16:58.523 INFO:teuthology.orchestra.run.smithi152.stdout:(20/166): python3-ceph-argparse-19.0.0-1686.g60 93 kB/s | 45 kB 00:00 2024-02-26T12:16:58.548 INFO:teuthology.orchestra.run.smithi152.stdout:(21/166): python3-ceph-common-19.0.0-1686.g6085 2.6 MB/s | 131 kB 00:00 2024-02-26T12:16:58.574 INFO:teuthology.orchestra.run.smithi152.stdout:(22/166): python3-cephfs-19.0.0-1686.g6085b91f. 3.2 MB/s | 162 kB 00:00 2024-02-26T12:16:58.607 INFO:teuthology.orchestra.run.smithi152.stdout:(23/166): python3-rados-19.0.0-1686.g6085b91f.e 5.3 MB/s | 320 kB 00:00 2024-02-26T12:16:58.632 INFO:teuthology.orchestra.run.smithi152.stdout:(24/166): python3-rbd-19.0.0-1686.g6085b91f.el9 5.0 MB/s | 298 kB 00:00 2024-02-26T12:16:58.658 INFO:teuthology.orchestra.run.smithi152.stdout:(25/166): python3-rgw-19.0.0-1686.g6085b91f.el9 1.9 MB/s | 100 kB 00:00 2024-02-26T12:16:58.683 INFO:teuthology.orchestra.run.smithi152.stdout:(26/166): rbd-fuse-19.0.0-1686.g6085b91f.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-26T12:16:58.775 INFO:teuthology.orchestra.run.smithi152.stdout:(27/166): rbd-nbd-19.0.0-1686.g6085b91f.el9.x86 1.8 MB/s | 170 kB 00:00 2024-02-26T12:16:58.818 INFO:teuthology.orchestra.run.smithi113.stdout:(107/166): grpc-data-1.46.7-10.el9.noarch.rpm 57 kB/s | 19 kB 00:00 2024-02-26T12:16:58.850 INFO:teuthology.orchestra.run.smithi152.stdout:(28/166): rbd-mirror-19.0.0-1686.g6085b91f.el9. 16 MB/s | 3.1 MB 00:00 2024-02-26T12:16:58.860 INFO:teuthology.orchestra.run.smithi113.stdout:(108/166): gperftools-libs-2.9.1-2.el9.x86_64.r 501 kB/s | 309 kB 00:00 2024-02-26T12:16:58.867 INFO:teuthology.orchestra.run.smithi152.stdout:(29/166): ceph-grafana-dashboards-19.0.0-1686.g 341 kB/s | 31 kB 00:00 2024-02-26T12:16:58.901 INFO:teuthology.orchestra.run.smithi152.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1686.g6085b91 2.7 MB/s | 138 kB 00:00 2024-02-26T12:16:58.952 INFO:teuthology.orchestra.run.smithi113.stdout:(109/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-02-26T12:16:59.060 INFO:teuthology.orchestra.run.smithi113.stdout:(110/166): abseil-cpp-20211102.0-3.el9.x86_64.r 657 kB/s | 548 kB 00:00 2024-02-26T12:16:59.101 INFO:teuthology.orchestra.run.smithi152.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1686.g6085b 7.6 MB/s | 1.8 MB 00:00 2024-02-26T12:16:59.128 INFO:teuthology.orchestra.run.smithi113.stdout:(111/166): liboath-2.6.7-2.el9.x86_64.rpm 277 kB/s | 49 kB 00:00 2024-02-26T12:16:59.161 INFO:teuthology.orchestra.run.smithi113.stdout:(112/166): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-02-26T12:16:59.193 INFO:teuthology.orchestra.run.smithi152.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1686.g60 2.6 MB/s | 248 kB 00:00 2024-02-26T12:16:59.253 INFO:teuthology.orchestra.run.smithi113.stdout:(113/166): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-02-26T12:16:59.260 INFO:teuthology.orchestra.run.smithi152.stdout:(33/166): ceph-mgr-rook-19.0.0-1686.g6085b91f.e 742 kB/s | 49 kB 00:00 2024-02-26T12:16:59.344 INFO:teuthology.orchestra.run.smithi152.stdout:(34/166): ceph-mgr-diskprediction-local-19.0.0- 17 MB/s | 7.4 MB 00:00 2024-02-26T12:16:59.362 INFO:teuthology.orchestra.run.smithi113.stdout:(114/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2024-02-26T12:16:59.369 INFO:teuthology.orchestra.run.smithi152.stdout:(35/166): ceph-prometheus-alerts-19.0.0-1686.g6 141 kB/s | 15 kB 00:00 2024-02-26T12:16:59.394 INFO:teuthology.orchestra.run.smithi152.stdout:(36/166): ceph-volume-19.0.0-1686.g6085b91f.el9 5.1 MB/s | 264 kB 00:00 2024-02-26T12:16:59.428 INFO:teuthology.orchestra.run.smithi152.stdout:(37/166): cephfs-top-19.0.0-1686.g6085b91f.el9. 549 kB/s | 18 kB 00:00 2024-02-26T12:16:59.462 INFO:teuthology.orchestra.run.smithi113.stdout:(115/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-02-26T12:16:59.470 INFO:teuthology.orchestra.run.smithi152.stdout:(38/166): cephadm-19.0.0-1686.g6085b91f.el9.noa 7.3 MB/s | 748 kB 00:00 2024-02-26T12:16:59.487 INFO:teuthology.orchestra.run.smithi113.stdout:(116/166): python3-asyncssh-2.13.2-4.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-02-26T12:16:59.546 INFO:teuthology.orchestra.run.smithi152.stdout:(39/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 150 kB/s | 18 kB 00:00 2024-02-26T12:16:59.563 INFO:teuthology.orchestra.run.smithi113.stdout:(117/166): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-02-26T12:16:59.588 INFO:teuthology.orchestra.run.smithi113.stdout:(118/166): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-02-26T12:16:59.646 INFO:teuthology.orchestra.run.smithi113.stdout:(119/166): libarrow-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-02-26T12:16:59.672 INFO:teuthology.orchestra.run.smithi113.stdout:(120/166): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-02-26T12:16:59.679 INFO:teuthology.orchestra.run.smithi152.stdout:(40/166): fuse-2.9.9-15.el9.x86_64.rpm 385 kB/s | 80 kB 00:00 2024-02-26T12:16:59.722 INFO:teuthology.orchestra.run.smithi113.stdout:(121/166): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-02-26T12:16:59.756 INFO:teuthology.orchestra.run.smithi113.stdout:(122/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-02-26T12:16:59.781 INFO:teuthology.orchestra.run.smithi113.stdout:(123/166): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-02-26T12:16:59.821 INFO:teuthology.orchestra.run.smithi152.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 680 kB/s | 187 kB 00:00 2024-02-26T12:16:59.840 INFO:teuthology.orchestra.run.smithi113.stdout:(124/166): python3-google-auth-2.28.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-02-26T12:16:59.882 INFO:teuthology.orchestra.run.smithi113.stdout:(125/166): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-02-26T12:16:59.924 INFO:teuthology.orchestra.run.smithi113.stdout:(126/166): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-02-26T12:16:59.930 INFO:teuthology.orchestra.run.smithi152.stdout:(42/166): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-02-26T12:16:59.949 INFO:teuthology.orchestra.run.smithi113.stdout:(127/166): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-02-26T12:16:59.963 INFO:teuthology.orchestra.run.smithi152.stdout:(43/166): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-02-26T12:16:59.982 INFO:teuthology.orchestra.run.smithi113.stdout:(128/166): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-02-26T12:16:59.989 INFO:teuthology.orchestra.run.smithi152.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-02-26T12:17:00.016 INFO:teuthology.orchestra.run.smithi113.stdout:(129/166): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-02-26T12:17:00.041 INFO:teuthology.orchestra.run.smithi113.stdout:(130/166): python3-jaraco-functools-3.5.0-2.el9 210 kB/s | 19 kB 00:00 2024-02-26T12:17:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-02-26T12:17:00.084 INFO:teuthology.orchestra.run.smithi113.stdout:(131/166): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-02-26T12:17:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:(46/166): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-02-26T12:17:00.142 INFO:teuthology.orchestra.run.smithi113.stdout:(132/166): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-02-26T12:17:00.156 INFO:teuthology.orchestra.run.smithi152.stdout:(47/166): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-02-26T12:17:00.184 INFO:teuthology.orchestra.run.smithi113.stdout:(133/166): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-02-26T12:17:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:(134/166): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-02-26T12:17:00.243 INFO:teuthology.orchestra.run.smithi113.stdout:(135/166): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-02-26T12:17:00.293 INFO:teuthology.orchestra.run.smithi113.stdout:(136/166): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-02-26T12:17:00.319 INFO:teuthology.orchestra.run.smithi113.stdout:(137/166): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-02-26T12:17:00.341 INFO:teuthology.orchestra.run.smithi152.stdout:(48/166): ceph-osd-19.0.0-1686.g6085b91f.el9.x8 3.3 MB/s | 17 MB 00:05 2024-02-26T12:17:00.344 INFO:teuthology.orchestra.run.smithi113.stdout:(138/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-02-26T12:17:00.374 INFO:teuthology.orchestra.run.smithi152.stdout:(49/166): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-02-26T12:17:00.394 INFO:teuthology.orchestra.run.smithi113.stdout:(139/166): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-02-26T12:17:00.399 INFO:teuthology.orchestra.run.smithi152.stdout:(50/166): python3-requests-2.25.1-8.el9.noarch. 515 kB/s | 125 kB 00:00 2024-02-26T12:17:00.411 INFO:teuthology.orchestra.run.smithi113.stdout:(140/166): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-02-26T12:17:00.425 INFO:teuthology.orchestra.run.smithi152.stdout:(51/166): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-02-26T12:17:00.445 INFO:teuthology.orchestra.run.smithi113.stdout:(141/166): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-02-26T12:17:00.487 INFO:teuthology.orchestra.run.smithi113.stdout:(142/166): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2024-02-26T12:17:00.504 INFO:teuthology.orchestra.run.smithi113.stdout:(143/166): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-02-26T12:17:00.537 INFO:teuthology.orchestra.run.smithi113.stdout:(144/166): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-02-26T12:17:00.596 INFO:teuthology.orchestra.run.smithi113.stdout:(145/166): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-26T12:17:00.616 INFO:teuthology.orchestra.run.smithi152.stdout:(52/166): boost-program-options-1.75.0-8.el9.x8 558 kB/s | 107 kB 00:00 2024-02-26T12:17:00.621 INFO:teuthology.orchestra.run.smithi113.stdout:(146/166): python3-websocket-client-1.2.3-2.el9 765 kB/s | 90 kB 00:00 2024-02-26T12:17:00.655 INFO:teuthology.orchestra.run.smithi113.stdout:(147/166): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-02-26T12:17:00.675 INFO:teuthology.orchestra.run.smithi152.stdout:(53/166): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-02-26T12:17:00.697 INFO:teuthology.orchestra.run.smithi113.stdout:(148/166): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-02-26T12:17:00.722 INFO:teuthology.orchestra.run.smithi113.stdout:(149/166): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-02-26T12:17:00.734 INFO:teuthology.orchestra.run.smithi152.stdout:(54/166): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 689 kB 00:00 2024-02-26T12:17:00.776 INFO:teuthology.orchestra.run.smithi152.stdout:(55/166): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-02-26T12:17:00.801 INFO:teuthology.orchestra.run.smithi152.stdout:(56/166): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-02-26T12:17:00.806 INFO:teuthology.orchestra.run.smithi113.stdout:(150/166): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-02-26T12:17:00.826 INFO:teuthology.orchestra.run.smithi152.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-02-26T12:17:00.860 INFO:teuthology.orchestra.run.smithi152.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-02-26T12:17:00.894 INFO:teuthology.orchestra.run.smithi152.stdout:(59/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-02-26T12:17:00.919 INFO:teuthology.orchestra.run.smithi152.stdout:(60/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-02-26T12:17:01.011 INFO:teuthology.orchestra.run.smithi152.stdout:(61/166): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-02-26T12:17:01.044 INFO:teuthology.orchestra.run.smithi152.stdout:(62/166): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 582 kB 00:00 2024-02-26T12:17:01.070 INFO:teuthology.orchestra.run.smithi152.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 436 kB/s | 26 kB 00:00 2024-02-26T12:17:01.120 INFO:teuthology.orchestra.run.smithi152.stdout:(64/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-02-26T12:17:01.145 INFO:teuthology.orchestra.run.smithi152.stdout:(65/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 470 kB/s | 47 kB 00:00 2024-02-26T12:17:01.147 INFO:teuthology.orchestra.run.smithi113.stdout:(151/166): librados2-19.0.0-1686.g6085b91f.el9. 7.5 MB/s | 3.4 MB 00:00 2024-02-26T12:17:01.171 INFO:teuthology.orchestra.run.smithi152.stdout:(66/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-02-26T12:17:01.196 INFO:teuthology.orchestra.run.smithi152.stdout:(67/166): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-02-26T12:17:01.221 INFO:teuthology.orchestra.run.smithi152.stdout:(68/166): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-02-26T12:17:01.273 INFO:teuthology.orchestra.run.smithi113.stdout:(152/166): librbd1-19.0.0-1686.g6085b91f.el9.x8 6.0 MB/s | 3.1 MB 00:00 2024-02-26T12:17:01.413 INFO:teuthology.orchestra.run.smithi152.stdout:(69/166): postgresql-13.11-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-02-26T12:17:01.580 INFO:teuthology.orchestra.run.smithi152.stdout:(70/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2024-02-26T12:17:01.622 INFO:teuthology.orchestra.run.smithi152.stdout:(71/166): postgresql-contrib-13.11-1.el9.x86_64 4.2 MB/s | 905 kB 00:00 2024-02-26T12:17:01.689 INFO:teuthology.orchestra.run.smithi152.stdout:(72/166): openblas-openmp-0.3.21-2.el9.x86_64.r 9.2 MB/s | 4.7 MB 00:00 2024-02-26T12:17:01.714 INFO:teuthology.orchestra.run.smithi152.stdout:(73/166): postgresql-private-libs-13.11-1.el9.x 1.0 MB/s | 135 kB 00:00 2024-02-26T12:17:01.723 INFO:teuthology.orchestra.run.smithi113.stdout:(153/166): NetworkManager-team-1.45.91-1.el9.x8 94 kB/s | 42 kB 00:00 2024-02-26T12:17:01.806 INFO:teuthology.orchestra.run.smithi152.stdout:(74/166): python3-attrs-20.3.0-7.el9.noarch.rpm 955 kB/s | 87 kB 00:00 2024-02-26T12:17:01.856 INFO:teuthology.orchestra.run.smithi152.stdout:(75/166): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-02-26T12:17:01.857 INFO:teuthology.orchestra.run.smithi113.stdout:(154/166): NetworkManager-1.45.91-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-02-26T12:17:01.940 INFO:teuthology.orchestra.run.smithi152.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-02-26T12:17:01.974 INFO:teuthology.orchestra.run.smithi113.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 611 kB/s | 71 kB 00:00 2024-02-26T12:17:02.007 INFO:teuthology.orchestra.run.smithi152.stdout:(77/166): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-02-26T12:17:02.057 INFO:teuthology.orchestra.run.smithi113.stdout:(156/166): NetworkManager-tui-1.45.91-1.el9.x86 740 kB/s | 247 kB 00:00 2024-02-26T12:17:02.074 INFO:teuthology.orchestra.run.smithi152.stdout:(78/166): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-02-26T12:17:02.091 INFO:teuthology.orchestra.run.smithi113.stdout:(157/166): elfutils-debuginfod-client-0.190-2.e 311 kB/s | 36 kB 00:00 2024-02-26T12:17:02.132 INFO:teuthology.orchestra.run.smithi152.stdout:(79/166): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-02-26T12:17:02.174 INFO:teuthology.orchestra.run.smithi113.stdout:(158/166): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-02-26T12:17:02.200 INFO:teuthology.orchestra.run.smithi152.stdout:(80/166): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-02-26T12:17:02.225 INFO:teuthology.orchestra.run.smithi113.stdout:(159/166): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-02-26T12:17:02.267 INFO:teuthology.orchestra.run.smithi152.stdout:(81/166): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-02-26T12:17:02.292 INFO:teuthology.orchestra.run.smithi152.stdout:(82/166): python3-markupsafe-1.1.1-12.el9.x86_6 378 kB/s | 35 kB 00:00 2024-02-26T12:17:02.292 INFO:teuthology.orchestra.run.smithi113.stdout:(160/166): libacl-2.3.1-4.el9.x86_64.rpm 196 kB/s | 23 kB 00:00 2024-02-26T12:17:02.358 INFO:teuthology.orchestra.run.smithi152.stdout:(83/166): postgresql-server-13.11-1.el9.x86_64. 7.8 MB/s | 5.7 MB 00:00 2024-02-26T12:17:02.359 INFO:teuthology.orchestra.run.smithi113.stdout:(161/166): openssl-3.0.7-25.el9.x86_64.rpm 9.1 MB/s | 1.2 MB 00:00 2024-02-26T12:17:02.384 INFO:teuthology.orchestra.run.smithi152.stdout:(84/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-02-26T12:17:02.434 INFO:teuthology.orchestra.run.smithi152.stdout:(85/166): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-02-26T12:17:02.476 INFO:teuthology.orchestra.run.smithi113.stdout:(162/166): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-02-26T12:17:02.501 INFO:teuthology.orchestra.run.smithi152.stdout:(86/166): python3-packaging-20.9-5.el9.noarch.r 659 kB/s | 77 kB 00:00 2024-02-26T12:17:02.518 INFO:teuthology.orchestra.run.smithi152.stdout:(87/166): python3-prettytable-0.7.2-27.el9.noar 504 kB/s | 42 kB 00:00 2024-02-26T12:17:02.609 INFO:teuthology.orchestra.run.smithi113.stdout:(163/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2024-02-26T12:17:02.610 INFO:teuthology.orchestra.run.smithi152.stdout:(88/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-02-26T12:17:02.635 INFO:teuthology.orchestra.run.smithi152.stdout:(89/166): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-02-26T12:17:02.661 INFO:teuthology.orchestra.run.smithi152.stdout:(90/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-02-26T12:17:02.686 INFO:teuthology.orchestra.run.smithi152.stdout:(91/166): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-02-26T12:17:02.703 INFO:teuthology.orchestra.run.smithi152.stdout:(92/166): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-02-26T12:17:02.728 INFO:teuthology.orchestra.run.smithi152.stdout:(93/166): python3-requests-oauthlib-1.3.0-12.el 795 kB/s | 54 kB 00:00 2024-02-26T12:17:02.738 INFO:teuthology.orchestra.run.smithi113.stdout:(164/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.9 MB/s | 2.2 MB 00:00 2024-02-26T12:17:02.779 INFO:teuthology.orchestra.run.smithi152.stdout:(94/166): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-02-26T12:17:02.796 INFO:teuthology.orchestra.run.smithi152.stdout:(95/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 661 kB/s | 44 kB 00:00 2024-02-26T12:17:02.801 INFO:teuthology.orchestra.run.smithi113.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 388 kB/s | 74 kB 00:00 2024-02-26T12:17:02.846 INFO:teuthology.orchestra.run.smithi152.stdout:(96/166): qatlib-23.11.0-1.el9.x86_64.rpm 3.2 MB/s | 216 kB 00:00 2024-02-26T12:17:02.863 INFO:teuthology.orchestra.run.smithi152.stdout:(97/166): qatlib-service-23.11.0-1.el9.x86_64.r 521 kB/s | 35 kB 00:00 2024-02-26T12:17:02.896 INFO:teuthology.orchestra.run.smithi152.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 889 kB/s | 44 kB 00:00 2024-02-26T12:17:02.939 INFO:teuthology.orchestra.run.smithi152.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-02-26T12:17:02.955 INFO:teuthology.orchestra.run.smithi152.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-02-26T12:17:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-02-26T12:17:03.031 INFO:teuthology.orchestra.run.smithi152.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-02-26T12:17:03.081 INFO:teuthology.orchestra.run.smithi152.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-02-26T12:17:03.157 INFO:teuthology.orchestra.run.smithi152.stdout:(104/166): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-02-26T12:17:03.449 INFO:teuthology.orchestra.run.smithi152.stdout:(105/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-02-26T12:17:03.599 INFO:teuthology.orchestra.run.smithi152.stdout:(106/166): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-02-26T12:17:03.601 INFO:teuthology.orchestra.run.smithi113.stdout:(166/166): NetworkManager-libnm-1.45.91-1.el9.x 757 kB/s | 1.8 MB 00:02 2024-02-26T12:17:03.609 INFO:teuthology.orchestra.run.smithi113.stdout:-------------------------------------------------------------------------------- 2024-02-26T12:17:03.609 INFO:teuthology.orchestra.run.smithi113.stdout:Total 12 MB/s | 222 MB 00:18 2024-02-26T12:17:03.624 INFO:teuthology.orchestra.run.smithi152.stdout:(107/166): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-02-26T12:17:03.658 INFO:teuthology.orchestra.run.smithi152.stdout:(108/166): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-02-26T12:17:03.683 INFO:teuthology.orchestra.run.smithi152.stdout:(109/166): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-02-26T12:17:03.750 INFO:teuthology.orchestra.run.smithi152.stdout:(110/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-02-26T12:17:03.775 INFO:teuthology.orchestra.run.smithi152.stdout:(111/166): liboath-2.6.7-2.el9.x86_64.rpm 541 kB/s | 49 kB 00:00 2024-02-26T12:17:03.850 INFO:teuthology.orchestra.run.smithi152.stdout:(112/166): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-02-26T12:17:03.876 INFO:teuthology.orchestra.run.smithi152.stdout:(113/166): libunwind-1.6.2-1.el9.x86_64.rpm 690 kB/s | 67 kB 00:00 2024-02-26T12:17:03.892 INFO:teuthology.orchestra.run.smithi152.stdout:(114/166): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-02-26T12:17:04.856 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction check 2024-02-26T12:17:05.156 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction check succeeded. 2024-02-26T12:17:05.156 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction test 2024-02-26T12:17:06.601 INFO:teuthology.orchestra.run.smithi152.stdout:(115/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 305 kB/s | 838 kB 00:02 2024-02-26T12:17:06.801 INFO:teuthology.orchestra.run.smithi152.stdout:(116/166): python3-asyncssh-2.13.2-4.el9.noarch 188 kB/s | 548 kB 00:02 2024-02-26T12:17:06.827 INFO:teuthology.orchestra.run.smithi152.stdout:(117/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 15 kB/s | 43 kB 00:02 2024-02-26T12:17:06.851 INFO:teuthology.orchestra.run.smithi152.stdout:(118/166): python3-cachetools-4.2.4-1.el9.noarc 129 kB/s | 32 kB 00:00 2024-02-26T12:17:06.885 INFO:teuthology.orchestra.run.smithi152.stdout:(119/166): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-02-26T12:17:06.952 INFO:teuthology.orchestra.run.smithi152.stdout:(120/166): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-02-26T12:17:07.102 INFO:teuthology.orchestra.run.smithi152.stdout:(121/166): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-02-26T12:17:07.265 INFO:teuthology.orchestra.run.smithi113.stdout:Transaction test succeeded. 2024-02-26T12:17:07.266 INFO:teuthology.orchestra.run.smithi113.stdout:Running transaction 2024-02-26T12:17:07.378 INFO:teuthology.orchestra.run.smithi152.stdout:(122/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 616 kB/s | 303 kB 00:00 2024-02-26T12:17:07.411 INFO:teuthology.orchestra.run.smithi152.stdout:(123/166): python3-colorama-0.4.4-12.el9.noarch 77 kB/s | 35 kB 00:00 2024-02-26T12:17:07.829 INFO:teuthology.orchestra.run.smithi152.stdout:(124/166): python3-google-auth-2.28.0-1.el9.noa 279 kB/s | 203 kB 00:00 2024-02-26T12:17:10.878 INFO:teuthology.orchestra.run.smithi152.stdout:(125/166): python3-grpcio-1.46.7-10.el9.x86_64. 596 kB/s | 2.0 MB 00:03 2024-02-26T12:17:11.103 INFO:teuthology.orchestra.run.smithi152.stdout:(126/166): python3-grpcio-tools-1.46.7-10.el9.x 39 kB/s | 144 kB 00:03 2024-02-26T12:17:11.120 INFO:teuthology.orchestra.run.smithi152.stdout:(127/166): python3-jaraco-8.2.1-3.el9.noarch.rp 3.2 kB/s | 11 kB 00:03 2024-02-26T12:17:11.137 INFO:teuthology.orchestra.run.smithi152.stdout:(128/166): python3-jaraco-classes-3.2.1-5.el9.n 68 kB/s | 18 kB 00:00 2024-02-26T12:17:11.254 INFO:teuthology.orchestra.run.smithi152.stdout:(129/166): python3-jaraco-collections-3.0.0-8.e 154 kB/s | 23 kB 00:00 2024-02-26T12:17:11.413 INFO:teuthology.orchestra.run.smithi152.stdout:(130/166): python3-jaraco-functools-3.5.0-2.el9 71 kB/s | 19 kB 00:00 2024-02-26T12:17:11.538 INFO:teuthology.orchestra.run.smithi152.stdout:(131/166): python3-jaraco-text-3.2.0-6.el9.noar 49 kB/s | 20 kB 00:00 2024-02-26T12:17:13.878 INFO:teuthology.orchestra.run.smithi113.stdout: Preparing : 1/1 2024-02-26T12:17:13.996 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-26T12:17:14.042 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-26T12:17:14.098 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-26T12:17:14.130 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-26T12:17:14.156 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-26T12:17:14.198 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-26T12:17:14.254 INFO:teuthology.orchestra.run.smithi152.stdout:(132/166): python3-kubernetes-26.1.0-2.el9.noar 348 kB/s | 1.0 MB 00:02 2024-02-26T12:17:14.271 INFO:teuthology.orchestra.run.smithi152.stdout:(133/166): python3-logutils-0.3.5-21.el9.noarch 16 kB/s | 46 kB 00:02 2024-02-26T12:17:14.338 INFO:teuthology.orchestra.run.smithi152.stdout:(134/166): python3-more-itertools-8.12.0-2.el9. 28 kB/s | 79 kB 00:02 2024-02-26T12:17:14.489 INFO:teuthology.orchestra.run.smithi152.stdout:(135/166): python3-natsort-7.1.1-5.el9.noarch.r 247 kB/s | 58 kB 00:00 2024-02-26T12:17:14.526 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-26T12:17:14.582 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:17:14.696 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:17:14.725 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:17:14.747 INFO:teuthology.orchestra.run.smithi152.stdout:(136/166): python3-pecan-1.4.2-3.el9.noarch.rpm 573 kB/s | 272 kB 00:00 2024-02-26T12:17:14.764 INFO:teuthology.orchestra.run.smithi152.stdout:(137/166): python3-portend-3.1.0-2.el9.noarch.r 39 kB/s | 16 kB 00:00 2024-02-26T12:17:14.799 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:17:14.823 INFO:teuthology.orchestra.run.smithi152.stdout:(138/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 269 kB/s | 90 kB 00:00 2024-02-26T12:17:14.832 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 10/182 2024-02-26T12:17:14.840 INFO:teuthology.orchestra.run.smithi152.stdout:(139/166): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-02-26T12:17:14.857 INFO:teuthology.orchestra.run.smithi152.stdout:(140/166): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-02-26T12:17:14.917 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-26T12:17:15.032 INFO:teuthology.orchestra.run.smithi152.stdout:(141/166): python3-routes-2.5.1-5.el9.noarch.rp 902 kB/s | 188 kB 00:00 2024-02-26T12:17:15.041 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-26T12:17:15.057 INFO:teuthology.orchestra.run.smithi152.stdout:(142/166): python3-rsa-4.9-2.el9.noarch.rpm 272 kB/s | 59 kB 00:00 2024-02-26T12:17:15.083 INFO:teuthology.orchestra.run.smithi152.stdout:(143/166): python3-tempora-5.0.0-2.el9.noarch.r 158 kB/s | 36 kB 00:00 2024-02-26T12:17:15.108 INFO:teuthology.orchestra.run.smithi152.stdout:(144/166): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-02-26T12:17:15.227 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-26T12:17:15.233 INFO:teuthology.orchestra.run.smithi152.stdout:(145/166): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-02-26T12:17:15.275 INFO:teuthology.orchestra.run.smithi152.stdout:(146/166): python3-websocket-client-1.2.3-2.el9 467 kB/s | 90 kB 00:00 2024-02-26T12:17:15.283 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-26T12:17:15.307 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 15/182 2024-02-26T12:17:15.410 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 15/182 2024-02-26T12:17:15.433 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 16/182 2024-02-26T12:17:15.459 INFO:teuthology.orchestra.run.smithi152.stdout:(147/166): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2024-02-26T12:17:15.484 INFO:teuthology.orchestra.run.smithi152.stdout:(148/166): python3-zc-lockfile-2.0-10.el9.noarc 80 kB/s | 20 kB 00:00 2024-02-26T12:17:15.498 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 16/182 2024-02-26T12:17:15.526 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-26T12:17:15.541 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-26T12:17:15.576 INFO:teuthology.orchestra.run.smithi152.stdout:(149/166): re2-20211101-3.el9.x86_64.rpm 638 kB/s | 192 kB 00:00 2024-02-26T12:17:15.743 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-26T12:17:15.772 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-26T12:17:15.868 INFO:teuthology.orchestra.run.smithi152.stdout:(150/166): librbd1-19.0.0-1686.g6085b91f.el9.x8 11 MB/s | 3.1 MB 00:00 2024-02-26T12:17:15.957 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-26T12:17:16.082 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-26T12:17:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-26T12:17:16.222 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:16.266 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:16.285 INFO:teuthology.orchestra.run.smithi152.stdout:(151/166): librados2-19.0.0-1686.g6085b91f.el9. 4.2 MB/s | 3.4 MB 00:00 2024-02-26T12:17:16.335 INFO:teuthology.orchestra.run.smithi152.stdout:(152/166): NetworkManager-1.45.91-1.el9.x86_64. 4.9 MB/s | 2.3 MB 00:00 2024-02-26T12:17:16.377 INFO:teuthology.orchestra.run.smithi152.stdout:(153/166): NetworkManager-team-1.45.91-1.el9.x8 1.0 MB/s | 42 kB 00:00 2024-02-26T12:17:16.419 INFO:teuthology.orchestra.run.smithi152.stdout:(154/166): NetworkManager-tui-1.45.91-1.el9.x86 5.8 MB/s | 247 kB 00:00 2024-02-26T12:17:16.461 INFO:teuthology.orchestra.run.smithi152.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-02-26T12:17:16.492 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:16.503 INFO:teuthology.orchestra.run.smithi152.stdout:(156/166): elfutils-debuginfod-client-0.190-2.e 875 kB/s | 36 kB 00:00 2024-02-26T12:17:16.554 INFO:teuthology.orchestra.run.smithi152.stdout:(157/166): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2024-02-26T12:17:16.596 INFO:teuthology.orchestra.run.smithi152.stdout:(158/166): NetworkManager-libnm-1.45.91-1.el9.x 5.9 MB/s | 1.8 MB 00:00 2024-02-26T12:17:16.611 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-26T12:17:16.621 INFO:teuthology.orchestra.run.smithi152.stdout:(159/166): elfutils-libs-0.190-2.el9.x86_64.rpm 3.7 MB/s | 256 kB 00:00 2024-02-26T12:17:16.646 INFO:teuthology.orchestra.run.smithi152.stdout:(160/166): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-02-26T12:17:16.700 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-26T12:17:16.740 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-26T12:17:16.772 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-26T12:17:16.837 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-26T12:17:16.871 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-26T12:17:16.880 INFO:teuthology.orchestra.run.smithi152.stdout:(161/166): openssl-3.0.7-25.el9.x86_64.rpm 4.7 MB/s | 1.2 MB 00:00 2024-02-26T12:17:16.915 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-26T12:17:16.948 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-26T12:17:16.976 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-26T12:17:17.044 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-26T12:17:17.080 INFO:teuthology.orchestra.run.smithi152.stdout:(162/166): xfsdump-3.1.12-4.el9.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2024-02-26T12:17:17.106 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-26T12:17:17.122 INFO:teuthology.orchestra.run.smithi152.stdout:(163/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.5 MB/s | 2.2 MB 00:00 2024-02-26T12:17:17.146 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-26T12:17:17.189 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-26T12:17:17.264 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-26T12:17:17.298 INFO:teuthology.orchestra.run.smithi152.stdout:(164/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 425 kB/s | 74 kB 00:00 2024-02-26T12:17:17.300 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-common-2:19.0.0-1686.g6085b91f.el9. 36/182 2024-02-26T12:17:17.342 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el 37/182 2024-02-26T12:17:17.371 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_6 38/182 2024-02-26T12:17:17.381 INFO:teuthology.orchestra.run.smithi152.stdout:(165/166): thrift-0.15.0-2.el9.x86_64.rpm 843 kB/s | 1.6 MB 00:01 2024-02-26T12:17:17.440 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-26T12:17:17.473 INFO:teuthology.orchestra.run.smithi152.stdout:(166/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 2.7 MB/s | 1.1 MB 00:00 2024-02-26T12:17:17.477 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-02-26T12:17:17.477 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.9 MB/s | 222 MB 00:24 2024-02-26T12:17:17.486 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-26T12:17:17.559 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-26T12:17:17.718 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-26T12:17:17.781 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-26T12:17:18.294 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-26T12:17:18.385 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-26T12:17:18.421 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-26T12:17:18.451 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-26T12:17:18.491 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-26T12:17:18.528 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_6 49/182 2024-02-26T12:17:18.570 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-26T12:17:18.701 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-26T12:17:18.736 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-02-26T12:17:18.748 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-26T12:17:18.810 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-26T12:17:18.875 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-26T12:17:18.907 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-26T12:17:18.943 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-26T12:17:18.990 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-26T12:17:19.026 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-26T12:17:19.044 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-02-26T12:17:19.044 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-02-26T12:17:19.072 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-26T12:17:19.112 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-26T12:17:19.244 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-26T12:17:19.292 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-26T12:17:19.323 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-26T12:17:19.365 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-26T12:17:19.457 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-26T12:17:19.657 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 66/182 2024-02-26T12:17:19.698 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-26T12:17:19.730 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-26T12:17:19.755 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-26T12:17:19.842 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-26T12:17:19.972 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-26T12:17:20.012 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-26T12:17:20.041 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-26T12:17:20.078 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-26T12:17:20.113 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-26T12:17:20.145 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-26T12:17:20.175 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-26T12:17:20.209 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-26T12:17:20.243 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-26T12:17:20.284 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-26T12:17:20.319 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-26T12:17:20.406 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-26T12:17:20.449 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-26T12:17:20.480 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-26T12:17:20.528 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-26T12:17:20.625 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-26T12:17:20.674 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-26T12:17:21.177 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-02-26T12:17:21.178 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-02-26T12:17:21.391 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-26T12:17:21.437 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-26T12:17:21.471 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-26T12:17:21.604 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-26T12:17:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-26T12:17:22.074 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-26T12:17:22.106 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-26T12:17:22.282 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-26T12:17:22.321 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-26T12:17:22.407 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-26T12:17:23.055 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-26T12:17:23.177 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-26T12:17:24.400 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-26T12:17:24.492 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-26T12:17:24.528 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-26T12:17:24.561 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-26T12:17:24.869 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-26T12:17:24.893 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 105/182 2024-02-26T12:17:24.965 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 105/182 2024-02-26T12:17:24.998 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 106/182 2024-02-26T12:17:25.061 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-26T12:17:25.511 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-26T12:17:25.548 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 109/182 2024-02-26T12:17:25.603 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 109/182 2024-02-26T12:17:25.625 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 110/182 2024-02-26T12:17:27.803 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:27.838 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:27.912 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-02-26T12:17:28.002 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-26T12:17:28.049 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-26T12:17:28.104 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-26T12:17:28.136 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-26T12:17:28.161 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-26T12:17:28.212 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-26T12:17:28.390 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:28.433 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 112/182 2024-02-26T12:17:28.517 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 112/182 2024-02-26T12:17:28.517 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-26T12:17:28.517 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-26T12:17:28.517 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:28.552 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-26T12:17:28.559 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 113/182 2024-02-26T12:17:28.613 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:17:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:17:28.747 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:17:28.823 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:17:28.861 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 10/182 2024-02-26T12:17:28.948 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-26T12:17:29.043 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-26T12:17:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-26T12:17:29.299 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-26T12:17:29.328 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 15/182 2024-02-26T12:17:29.439 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 15/182 2024-02-26T12:17:29.463 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 16/182 2024-02-26T12:17:29.509 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 16/182 2024-02-26T12:17:29.530 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-26T12:17:29.546 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-26T12:17:29.739 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-26T12:17:29.768 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-26T12:17:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-26T12:17:30.093 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-26T12:17:30.155 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-26T12:17:30.252 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:30.315 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:30.528 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-26T12:17:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-26T12:17:30.731 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-26T12:17:30.774 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-26T12:17:30.808 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-26T12:17:30.872 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-26T12:17:30.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-26T12:17:30.958 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-26T12:17:30.991 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-26T12:17:31.019 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-26T12:17:31.086 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-26T12:17:31.141 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-26T12:17:31.181 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-26T12:17:31.215 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-26T12:17:31.290 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-26T12:17:31.326 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.0.0-1686.g6085b91f.el9. 36/182 2024-02-26T12:17:31.369 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el 37/182 2024-02-26T12:17:31.398 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_6 38/182 2024-02-26T12:17:31.467 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-26T12:17:31.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-26T12:17:31.586 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-26T12:17:31.719 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-26T12:17:31.773 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-26T12:17:32.294 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-26T12:17:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-26T12:17:32.421 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-26T12:17:32.461 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-26T12:17:32.500 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-26T12:17:32.537 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_6 49/182 2024-02-26T12:17:32.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-26T12:17:32.716 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-26T12:17:32.756 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-26T12:17:32.810 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-26T12:17:32.885 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-26T12:17:32.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-26T12:17:32.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-26T12:17:32.998 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-26T12:17:33.042 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-26T12:17:33.086 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-26T12:17:33.128 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-26T12:17:33.261 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-26T12:17:33.300 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-26T12:17:33.329 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-26T12:17:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-26T12:17:33.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-26T12:17:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 66/182 2024-02-26T12:17:33.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-26T12:17:33.579 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-26T12:17:33.603 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-26T12:17:33.684 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-26T12:17:33.803 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-26T12:17:33.860 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-26T12:17:33.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-26T12:17:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-26T12:17:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-26T12:17:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-26T12:17:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-26T12:17:34.082 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-26T12:17:34.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-26T12:17:34.156 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-26T12:17:34.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-26T12:17:34.277 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-26T12:17:34.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-26T12:17:34.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-26T12:17:34.400 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-26T12:17:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-26T12:17:34.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-26T12:17:35.278 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-26T12:17:35.317 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-26T12:17:35.351 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-26T12:17:35.449 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-26T12:17:35.500 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-26T12:17:35.587 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-26T12:17:35.628 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-26T12:17:35.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-26T12:17:35.842 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-26T12:17:35.927 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-26T12:17:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-26T12:17:36.672 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-26T12:17:37.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-26T12:17:37.970 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-26T12:17:37.997 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-26T12:17:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-26T12:17:38.338 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-26T12:17:38.377 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 105/182 2024-02-26T12:17:38.468 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 105/182 2024-02-26T12:17:38.498 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 106/182 2024-02-26T12:17:38.535 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-26T12:17:38.987 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-26T12:17:39.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 109/182 2024-02-26T12:17:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 109/182 2024-02-26T12:17:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 110/182 2024-02-26T12:17:40.162 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 113/182 2024-02-26T12:17:40.162 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /sys 2024-02-26T12:17:40.162 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /proc 2024-02-26T12:17:40.162 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /mnt 2024-02-26T12:17:40.163 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /var/tmp 2024-02-26T12:17:40.163 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /home 2024-02-26T12:17:40.163 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /root 2024-02-26T12:17:40.163 INFO:teuthology.orchestra.run.smithi113.stdout:skipping the directory /tmp 2024-02-26T12:17:40.163 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:40.322 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 114/182 2024-02-26T12:17:40.337 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 114/182 2024-02-26T12:17:40.337 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:40.337 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-26T12:17:40.337 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:41.255 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:41.291 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:41.825 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 115/182 2024-02-26T12:17:41.837 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 111/182 2024-02-26T12:17:41.850 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 115/182 2024-02-26T12:17:41.850 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:41.850 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-26T12:17:41.850 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-26T12:17:41.850 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-26T12:17:41.851 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:41.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 112/182 2024-02-26T12:17:41.979 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 112/182 2024-02-26T12:17:41.979 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-26T12:17:41.980 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-26T12:17:41.980 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:42.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 113/182 2024-02-26T12:17:42.059 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 116/182 2024-02-26T12:17:42.081 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 116/182 2024-02-26T12:17:42.082 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:42.082 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-26T12:17:42.082 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-26T12:17:42.082 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-26T12:17:42.082 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:42.518 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 117/182 2024-02-26T12:17:42.540 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 117/182 2024-02-26T12:17:42.541 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:42.541 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-26T12:17:42.541 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-26T12:17:42.541 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-26T12:17:42.541 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:42.639 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-26T12:17:42.696 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-26T12:17:42.755 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-26T12:17:42.934 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-26T12:17:42.977 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-26T12:17:43.054 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-26T12:17:43.151 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-26T12:17:43.281 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-26T12:17:43.319 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-26T12:17:43.351 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-26T12:17:43.390 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-26T12:17:43.418 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-26T12:17:43.455 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-26T12:17:43.896 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 131/182 2024-02-26T12:17:43.929 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 131/182 2024-02-26T12:17:43.960 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.e 132/182 2024-02-26T12:17:44.020 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f. 133/182 2024-02-26T12:17:44.043 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 134/182 2024-02-26T12:17:44.270 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 134/182 2024-02-26T12:17:44.302 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 135/182 2024-02-26T12:17:45.264 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 135/182 2024-02-26T12:17:45.294 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 136/182 2024-02-26T12:17:45.395 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 136/182 2024-02-26T12:17:45.562 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el 137/182 2024-02-26T12:17:45.613 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 138/182 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 138/182 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-26T12:17:45.636 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:45.682 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 139/182 2024-02-26T12:17:45.693 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 139/182 2024-02-26T12:17:45.791 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 140/182 2024-02-26T12:17:50.191 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 141/182 2024-02-26T12:17:50.256 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 142/182 2024-02-26T12:17:51.103 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-26T12:17:51.139 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 144/182 2024-02-26T12:17:51.162 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 144/182 2024-02-26T12:17:51.162 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:51.162 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-26T12:17:51.162 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-26T12:17:51.162 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-26T12:17:51.163 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:51.206 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1686.g6085b 145/182 2024-02-26T12:17:51.228 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1686.g6085b 145/182 2024-02-26T12:17:51.229 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:51.229 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-26T12:17:51.229 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:51.274 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 146/182 2024-02-26T12:17:51.296 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 146/182 2024-02-26T12:17:51.296 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:51.296 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-26T12:17:51.297 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-26T12:17:51.297 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-26T12:17:51.297 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:51.608 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 147/182 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 147/182 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-26T12:17:51.631 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:17:51.682 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 148/182 2024-02-26T12:17:51.724 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 149/182 2024-02-26T12:17:51.756 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-26T12:17:51.783 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-26T12:17:51.964 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 152/182 2024-02-26T12:17:52.005 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-26T12:17:52.037 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_ 154/182 2024-02-26T12:17:52.078 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-26T12:17:52.107 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-26T12:17:52.170 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-26T12:17:52.245 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-26T12:17:52.290 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-26T12:17:52.854 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:17:52.896 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:17:52.938 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:17:52.994 INFO:teuthology.orchestra.run.smithi113.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 113/182 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-02-26T12:17:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:53.780 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 114/182 2024-02-26T12:17:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 114/182 2024-02-26T12:17:53.795 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:53.795 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-26T12:17:53.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:53.811 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 162/182 2024-02-26T12:17:53.909 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-26T12:17:53.999 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-26T12:17:54.029 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-26T12:17:54.054 INFO:teuthology.orchestra.run.smithi113.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-26T12:17:54.080 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-26T12:17:54.105 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-26T12:17:54.131 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-26T12:17:54.132 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-26T12:17:54.202 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-26T12:17:54.232 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-26T12:17:54.258 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-26T12:17:54.283 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-26T12:17:54.308 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-26T12:17:54.308 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-26T12:17:54.393 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-26T12:17:54.418 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-26T12:17:54.424 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:17:54.424 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:17:54.612 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:17:54.613 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-26T12:17:54.704 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-26T12:17:54.754 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-26T12:17:54.781 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-26T12:17:54.813 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-26T12:17:54.879 INFO:teuthology.orchestra.run.smithi113.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-26T12:17:55.266 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 115/182 2024-02-26T12:17:55.291 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 115/182 2024-02-26T12:17:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-26T12:17:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-26T12:17:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-26T12:17:55.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:55.500 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 116/182 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 116/182 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-26T12:17:55.523 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:55.959 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 117/182 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 117/182 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-26T12:17:55.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:56.080 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-26T12:17:56.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-26T12:17:56.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-26T12:17:56.385 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-26T12:17:56.433 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-26T12:17:56.502 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-26T12:17:56.591 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-26T12:17:56.723 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-26T12:17:56.767 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-26T12:17:56.800 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-26T12:17:56.839 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-26T12:17:56.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-26T12:17:56.903 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-26T12:17:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 131/182 2024-02-26T12:17:57.384 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 131/182 2024-02-26T12:17:57.415 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.e 132/182 2024-02-26T12:17:57.476 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f. 133/182 2024-02-26T12:17:57.499 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 134/182 2024-02-26T12:17:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 134/182 2024-02-26T12:17:57.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 135/182 2024-02-26T12:17:58.721 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 135/182 2024-02-26T12:17:58.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 136/182 2024-02-26T12:17:58.859 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 136/182 2024-02-26T12:17:59.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el 137/182 2024-02-26T12:17:59.052 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 138/182 2024-02-26T12:17:59.075 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 138/182 2024-02-26T12:17:59.075 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:17:59.075 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-26T12:17:59.076 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-26T12:17:59.076 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-26T12:17:59.076 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:17:59.119 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 139/182 2024-02-26T12:17:59.130 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 139/182 2024-02-26T12:17:59.228 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 140/182 2024-02-26T12:18:00.185 INFO:teuthology.orchestra.run.smithi113.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-26T12:18:00.185 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 1/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 2/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 3/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 4/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1686.g6085b 5/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 6/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 7/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 10/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 11/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 12/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 13/182 2024-02-26T12:18:00.186 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 14/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_ 15/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 16/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 17/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_6 18/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 19/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 20/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el 21/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ceph-common-2:19.0.0-1686.g6085b91f.el9. 22/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_6 23/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 24/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 25/182 2024-02-26T12:18:00.187 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 26/182 2024-02-26T12:18:00.188 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 27/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 28/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 29/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f. 30/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 31/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 32/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 33/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el 34/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 35/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.e 36/182 2024-02-26T12:18:00.202 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 37/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 38/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 39/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-26T12:18:00.203 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-26T12:18:00.204 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-26T12:18:00.205 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-26T12:18:00.206 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-26T12:18:00.207 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-26T12:18:00.208 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-26T12:18:00.209 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-26T12:18:00.210 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-26T12:18:00.211 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 151/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 153/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-26T12:18:00.212 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-26T12:18:00.213 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-26T12:18:00.214 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-26T12:18:02.868 INFO:teuthology.orchestra.run.smithi113.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-26T12:18:02.868 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout:Upgraded: 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: acl-2.3.1-4.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-26T12:18:02.869 INFO:teuthology.orchestra.run.smithi113.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout:Installed: 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: automake-1.16.2-8.el9.noarch 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: bison-3.7.4-5.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-26T12:18:02.870 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-immutable-object-cache-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.871 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.872 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: flex-2.6.4-9.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: jq-1.6-16.el9.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-26T12:18:02.873 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.874 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: lua-5.4.4-4.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-26T12:18:02.875 INFO:teuthology.orchestra.run.smithi113.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-13.11-1.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-26T12:18:02.876 INFO:teuthology.orchestra.run.smithi113.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-26T12:18:02.877 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-26T12:18:02.878 INFO:teuthology.orchestra.run.smithi113.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-26T12:18:02.879 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-ply-3.11-14.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-26T12:18:02.880 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-26T12:18:02.881 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-26T12:18:02.882 INFO:teuthology.orchestra.run.smithi113.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: re2-1:20211101-3.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-26T12:18:02.883 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-26T12:18:02.884 INFO:teuthology.orchestra.run.smithi113.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-26T12:18:02.884 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:02.884 INFO:teuthology.orchestra.run.smithi113.stdout:Complete! 2024-02-26T12:18:03.378 DEBUG:teuthology.parallel:result is None 2024-02-26T12:18:03.617 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 141/182 2024-02-26T12:18:03.690 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 142/182 2024-02-26T12:18:04.539 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-26T12:18:04.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 144/182 2024-02-26T12:18:04.590 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 144/182 2024-02-26T12:18:04.590 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:18:04.590 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-26T12:18:04.590 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-26T12:18:04.591 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-26T12:18:04.591 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:04.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1686.g6085b 145/182 2024-02-26T12:18:04.666 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1686.g6085b 145/182 2024-02-26T12:18:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:18:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-26T12:18:04.666 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:04.710 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 146/182 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 146/182 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-26T12:18:04.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:05.044 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 147/182 2024-02-26T12:18:05.066 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 147/182 2024-02-26T12:18:05.066 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-26T12:18:05.066 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-26T12:18:05.066 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-26T12:18:05.067 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-26T12:18:05.067 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:05.118 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 148/182 2024-02-26T12:18:05.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 149/182 2024-02-26T12:18:05.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-26T12:18:05.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-26T12:18:05.401 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 152/182 2024-02-26T12:18:05.448 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-26T12:18:05.481 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_ 154/182 2024-02-26T12:18:05.513 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-26T12:18:05.542 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-26T12:18:05.607 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-26T12:18:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-26T12:18:05.699 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-26T12:18:06.271 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:18:06.307 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:18:06.342 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-26T12:18:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-26T12:18:07.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 162/182 2024-02-26T12:18:07.326 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-26T12:18:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-26T12:18:07.447 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-26T12:18:07.472 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-26T12:18:07.497 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-26T12:18:07.522 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-26T12:18:07.549 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-26T12:18:07.549 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-26T12:18:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-26T12:18:07.649 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-26T12:18:07.675 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-26T12:18:07.700 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-26T12:18:07.725 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-26T12:18:07.725 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-26T12:18:07.835 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-26T12:18:07.859 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-26T12:18:07.866 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:18:07.866 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:18:08.046 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-26T12:18:08.046 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-26T12:18:08.129 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-26T12:18:08.154 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-26T12:18:08.181 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-26T12:18:08.213 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-26T12:18:08.279 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-26T12:18:13.456 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 1/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 2/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 3/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 4/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1686.g6085b 5/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 6/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 7/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 8/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 9/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 10/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 11/182 2024-02-26T12:18:13.457 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 12/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 13/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 14/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_ 15/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 16/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 17/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_6 18/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86 19/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 20/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el 21/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.0.0-1686.g6085b91f.el9. 22/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_6 23/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 24/182 2024-02-26T12:18:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 25/182 2024-02-26T12:18:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 26/182 2024-02-26T12:18:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 27/182 2024-02-26T12:18:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 28/182 2024-02-26T12:18:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 29/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f. 30/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noa 31/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.n 32/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1686.g608 33/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el 34/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 35/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.e 36/182 2024-02-26T12:18:13.473 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 37/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 38/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 39/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-26T12:18:13.474 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-26T12:18:13.475 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-26T12:18:13.476 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-26T12:18:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-26T12:18:13.478 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-26T12:18:13.479 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-26T12:18:13.480 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-26T12:18:13.481 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 151/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 153/182 2024-02-26T12:18:13.482 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-26T12:18:13.483 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-26T12:18:13.484 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-26T12:18:13.487 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-26T12:18:13.487 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-26T12:18:13.487 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-26T12:18:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: acl-2.3.1-4.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-26T12:18:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.0.0-1686.g6085b91f.el9.noarch 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-26T12:18:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-16.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-26T12:18:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-26T12:18:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.11-1.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-26T12:18:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-26T12:18:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-26T12:18:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-02-26T12:18:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-26T12:18:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.0.0-1686.g6085b91f.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-3.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-26T12:18:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-26T12:18:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-26T12:18:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:16.306 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-02-26T12:18:16.783 DEBUG:teuthology.parallel:result is None 2024-02-26T12:18:16.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6085b91fefeb74bf4310344a87d81d3217ef7893 2024-02-26T12:18:16.921 DEBUG:teuthology.orchestra.run.smithi113:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-26T12:18:16.947 INFO:teuthology.orchestra.run.smithi113.stdout:19.0.0-1686.g6085b91f.el9 2024-02-26T12:18:16.948 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1686.g6085b91f.el9 2024-02-26T12:18:16.948 INFO:teuthology.task.install:The correct ceph version 19.0.0-1686.g6085b91f is installed. 2024-02-26T12:18:16.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6085b91fefeb74bf4310344a87d81d3217ef7893 2024-02-26T12:18:17.086 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-26T12:18:17.109 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-1686.g6085b91f.el9 2024-02-26T12:18:17.109 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1686.g6085b91f.el9 2024-02-26T12:18:17.110 INFO:teuthology.task.install:The correct ceph version 19.0.0-1686.g6085b91f is installed. 2024-02-26T12:18:17.111 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-26T12:18:17.112 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:17.112 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-26T12:18:17.147 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:17.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-26T12:18:17.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-26T12:18:17.181 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:17.181 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2024-02-26T12:18:17.217 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-26T12:18:17.286 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:17.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-02-26T12:18:17.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-26T12:18:17.385 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-26T12:18:17.386 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:17.386 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-26T12:18:17.416 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-26T12:18:17.484 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:17.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-26T12:18:17.512 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-26T12:18:17.579 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-26T12:18:17.580 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:17.580 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2024-02-26T12:18:17.607 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-26T12:18:17.675 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:17.675 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-02-26T12:18:17.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-26T12:18:17.770 INFO:teuthology.run_tasks:Running task ceph... 2024-02-26T12:18:17.865 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-26T12:18:17.865 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /var/log/ceph 2024-02-26T12:18:17.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-02-26T12:18:17.894 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-26T12:18:17.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-26T12:18:17.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-26T12:18:17.961 INFO:tasks.ceph:Creating extra log directories... 2024-02-26T12:18:17.961 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-26T12:18:18.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-26T12:18:18.034 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-26T12:18:18.035 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-26T12:18:18.035 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-26T12:18:18.035 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:18.035 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-26T12:18:18.082 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:18.203 DEBUG:teuthology.orchestra.run.smithi113:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:18.231 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:18.231 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-26T12:18:18.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:18.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:18.392 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-26T12:18:18.392 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-26T12:18:18.392 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678', 'branch': 'wip-vshankar-testing-20240226.064629', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7573678', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '7c0fbba6c508351b48a34af7de7b074eb29ad0f9'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240226.064629'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240226.064629', 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1879, 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893', 'sleep_before_teardown': 0, 'subset': '788/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240226.064629', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi113.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgzMb4SBKi8jhHofJlLFfmtu836Acx1Nmgnsi5e34UU9FNLewFT06lf/7kXOXGo6XbXAkGBYBbeyslye0Ym2ro=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCag7Cl00dKINPOhDr8vMoN/vVbOxSZ+rsYvCBXbF+WaVLA0F4xNLBQLYfsRmQrIYUcpfsBBpcfvzv2z7J+sE9w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '7c0fbba6c508351b48a34af7de7b074eb29ad0f9'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '6085b91fefeb74bf4310344a87d81d3217ef7893', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-26_10:07:12', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-26T12:18:18.393 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-26T12:18:18.396 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-26T12:18:18.442 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2024-02-26T12:18:18.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-02-26T12:18:18.509 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:18.509 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2024-02-26T12:18:18.530 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-26T12:18:18.530 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2024-02-26T12:18:18.584 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-26T12:18:18.584 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:18.584 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-26T12:18:18.584 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:18.584 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:18.585 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-02-26 12:17:55.239023848 +0000 2024-02-26T12:18:18.585 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-02-26 12:15:38.806996249 +0000 2024-02-26T12:18:18.585 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-02-26 12:15:38.806996249 +0000 2024-02-26T12:18:18.585 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-02-26 12:15:38.806996249 +0000 2024-02-26T12:18:18.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-26T12:18:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-02-26T12:18:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-02-26T12:18:18.650 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000211423 s, 2.4 MB/s 2024-02-26T12:18:18.651 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-26T12:18:18.708 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-02-26 12:17:55.240023826 +0000 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-02-26 12:15:39.141988970 +0000 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-02-26 12:15:39.141988970 +0000 2024-02-26T12:18:18.763 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-02-26 12:15:39.141988970 +0000 2024-02-26T12:18:18.764 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-26T12:18:18.829 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-02-26T12:18:18.829 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-02-26T12:18:18.829 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000247374 s, 2.1 MB/s 2024-02-26T12:18:18.830 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-26T12:18:18.886 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:18.941 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-02-26 12:17:55.240023826 +0000 2024-02-26T12:18:18.942 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-02-26 12:15:39.476981692 +0000 2024-02-26T12:18:18.942 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-02-26 12:15:39.476981692 +0000 2024-02-26T12:18:18.942 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-02-26 12:15:39.476981692 +0000 2024-02-26T12:18:18.942 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-26T12:18:19.006 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-02-26T12:18:19.007 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-02-26T12:18:19.007 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000208748 s, 2.5 MB/s 2024-02-26T12:18:19.008 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-26T12:18:19.064 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2024-02-26T12:18:19.122 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2024-02-26 12:17:55.241023805 +0000 2024-02-26T12:18:19.153 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2024-02-26 12:15:39.813974370 +0000 2024-02-26T12:18:19.154 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2024-02-26 12:15:39.813974370 +0000 2024-02-26T12:18:19.154 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: 2024-02-26 12:15:39.813974370 +0000 2024-02-26T12:18:19.154 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-26T12:18:19.197 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2024-02-26T12:18:19.198 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2024-02-26T12:18:19.198 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000175535 s, 2.9 MB/s 2024-02-26T12:18:19.199 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-26T12:18:19.263 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:19.264 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:19.264 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-02-26T12:18:19.283 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-26T12:18:19.283 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-26 12:18:08.612236534 +0000 2024-02-26T12:18:19.343 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-26 12:15:31.084190894 +0000 2024-02-26T12:18:19.344 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-26 12:15:31.084190894 +0000 2024-02-26T12:18:19.344 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-26 12:15:31.084190894 +0000 2024-02-26T12:18:19.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-26T12:18:19.414 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-26T12:18:19.414 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-26T12:18:19.414 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00021524 s, 2.4 MB/s 2024-02-26T12:18:19.415 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-26T12:18:19.483 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-02-26T12:18:19.541 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-26 12:18:08.612236534 +0000 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-26 12:15:31.434186727 +0000 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-26 12:15:31.434186727 +0000 2024-02-26T12:18:19.542 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-26 12:15:31.434186727 +0000 2024-02-26T12:18:19.542 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-26T12:18:19.612 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-26T12:18:19.612 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-26T12:18:19.612 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000191929 s, 2.7 MB/s 2024-02-26T12:18:19.613 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-26T12:18:19.674 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-02-26T12:18:19.731 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-26T12:18:19.731 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:19.731 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-02-26T12:18:19.731 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:19.731 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:19.732 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-26 12:18:08.613236522 +0000 2024-02-26T12:18:19.732 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-26 12:15:31.790182488 +0000 2024-02-26T12:18:19.732 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-26 12:15:31.790182488 +0000 2024-02-26T12:18:19.732 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-26 12:15:31.790182488 +0000 2024-02-26T12:18:19.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-26T12:18:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-26T12:18:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-26T12:18:19.800 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000206923 s, 2.5 MB/s 2024-02-26T12:18:19.800 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-26T12:18:19.865 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-02-26T12:18:19.926 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-26T12:18:19.926 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-26T12:18:19.926 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-26T12:18:19.926 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-26T12:18:19.926 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-02-26T12:18:19.927 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-02-26 12:18:08.613236522 +0000 2024-02-26T12:18:19.927 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-02-26 12:15:32.123178524 +0000 2024-02-26T12:18:19.927 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-02-26 12:15:32.123178524 +0000 2024-02-26T12:18:19.927 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-02-26 12:15:32.123178524 +0000 2024-02-26T12:18:19.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-26T12:18:19.997 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-02-26T12:18:19.997 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-02-26T12:18:19.997 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000187384 s, 2.7 MB/s 2024-02-26T12:18:19.998 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-26T12:18:20.060 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:20.060 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-26T12:18:20.060 INFO:tasks.ceph:Generating config... 2024-02-26T12:18:20.061 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-26T12:18:20.061 INFO:tasks.ceph:[client] debug client = 20 2024-02-26T12:18:20.061 INFO:tasks.ceph:[client] debug ms = 1 2024-02-26T12:18:20.061 INFO:tasks.ceph:[client] pid file = 2024-02-26T12:18:20.062 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-26T12:18:20.062 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-26T12:18:20.062 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-26T12:18:20.062 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-26T12:18:20.063 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-26T12:18:20.063 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] bdev async discard = True 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-26T12:18:20.063 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-26T12:18:20.064 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-26T12:18:20.064 INFO:tasks.ceph:Setting up mon.a... 2024-02-26T12:18:20.064 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-26T12:18:20.124 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.keyring 2024-02-26T12:18:20.127 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-26T12:18:20.173 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-26T12:18:20.201 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.113'), ('mon.b', '172.21.15.152'), ('mon.c', '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]')] 2024-02-26T12:18:20.202 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.113,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-26T12:18:20.203 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:20.203 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-26T12:18:20.263 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.113 --add b 172.21.15.152 --addv c '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:20.348 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:20.348 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: generated fsid 74a57275-9dde-4d5b-99d3-80ee62f4964a 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:setting min_mon_release = quincy 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:epoch 0 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:fsid 74a57275-9dde-4d5b-99d3-80ee62f4964a 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:last_changed 2024-02-26T12:18:20.363645+0000 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:created 2024-02-26T12:18:20.363645+0000 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:min_mon_release 17 (quincy) 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:election_strategy: 1 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:0: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.a 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:2: [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] mon.c 2024-02-26T12:18:20.349 INFO:teuthology.orchestra.run.smithi113.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-26T12:18:20.351 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-26T12:18:20.407 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 74a57275-9dde-4d5b-99d3-80ee62f4964a... 2024-02-26T12:18:20.409 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-26T12:18:20.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-26T12:18:20.497 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.498 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2024-02-26T12:18:20.499 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2024-02-26T12:18:20.500 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.113,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on skipped message = False 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 74a57275-9dde-4d5b-99d3-80ee62f4964a 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd mclock profile = high_recovery_ops 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2024-02-26T12:18:20.501 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug trim objects = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.502 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore allocator = bitmap 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2024-02-26T12:18:20.503 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-02-26T12:18:20.504 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2024-02-26T12:18:20.505 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: # 1m isn't quite enough 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: mon_down_mkfs_grace = 2m 2024-02-26T12:18:20.506 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_filestore_osds = false 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = "" 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2024-02-26T12:18:20.507 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = True 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2024-02-26T12:18:20.508 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = True 2024-02-26T12:18:20.509 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2024-02-26T12:18:20.509 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2024-02-26T12:18:20.509 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2024-02-26T12:18:20.509 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-02-26T12:18:20.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-02-26T12:18:20.511 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.512 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.113,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on skipped message = False 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 74a57275-9dde-4d5b-99d3-80ee62f4964a 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-02-26T12:18:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-02-26T12:18:20.514 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-02-26T12:18:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2024-02-26T12:18:20.516 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-02-26T12:18:20.517 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-02-26T12:18:20.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-02-26T12:18:20.519 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-02-26T12:18:20.520 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2024-02-26T12:18:20.521 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2024-02-26T12:18:20.522 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2024-02-26T12:18:20.522 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-02-26T12:18:20.522 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-02-26T12:18:20.522 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-02-26T12:18:20.523 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-26T12:18:20.523 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-26T12:18:20.620 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-26T12:18:20.621 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:20.621 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-26T12:18:20.636 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:20.636 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-26T12:18:20.692 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:18:20.692 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:20.692 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-26T12:18:20.692 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-26T12:18:20.771 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:20.772 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:20.828 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:18:20.829 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:20.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-26T12:18:20.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-26T12:18:20.868 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:20.868 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:20.923 INFO:tasks.ceph:Setting up mon nodes... 2024-02-26T12:18:20.923 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-26T12:18:20.924 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-26T12:18:20.978 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-26T12:18:20.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-26T12:18:21.050 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-26T12:18:21.052 INFO:tasks.ceph:Setting up mds nodes... 2024-02-26T12:18:21.052 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-26T12:18:21.107 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-26T12:18:21.109 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-26T12:18:21.136 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-26T12:18:21.230 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-26T12:18:21.233 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-26T12:18:21.259 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-26T12:18:21.314 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-26T12:18:21.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-26T12:18:21.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-26T12:18:21.438 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-26T12:18:21.440 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-26T12:18:21.467 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-26T12:18:21.467 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-26T12:18:21.513 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-26T12:18:21.528 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-02-26T12:18:21.610 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-02-26T12:18:21.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-26T12:18:21.667 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-02-26T12:18:21.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-02-26T12:18:21.764 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-02-26T12:18:21.780 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-26T12:18:21.780 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-02-26T12:18:21.780 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-26T12:18:21.807 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:21.807 INFO:tasks.ceph:role: osd.0 2024-02-26T12:18:21.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:18:21.807 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-26T12:18:21.883 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:21.884 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:22.408 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-02-26T12:18:22.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-02-26T12:18:22.410 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-26T12:18:22.516 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-26T12:18:22.548 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-26T12:18:22.615 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:22.615 INFO:tasks.ceph:role: osd.1 2024-02-26T12:18:22.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:18:22.615 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-26T12:18:22.689 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:22.689 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:22.689 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:22.690 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:23.175 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-02-26T12:18:23.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-02-26T12:18:23.177 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-02-26T12:18:23.292 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-26T12:18:23.324 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-26T12:18:23.392 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:23.392 INFO:tasks.ceph:role: osd.2 2024-02-26T12:18:23.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:18:23.392 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:23.467 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:23.468 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:23.468 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:23.468 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:24.011 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-02-26T12:18:24.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-02-26T12:18:24.013 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-02-26T12:18:24.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-26T12:18:24.158 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-26T12:18:24.226 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:24.226 INFO:tasks.ceph:role: osd.3 2024-02-26T12:18:24.226 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:18:24.226 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:24.302 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:24.814 INFO:teuthology.orchestra.run.smithi113.stdout:Discarding blocks...Done. 2024-02-26T12:18:24.816 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2024-02-26T12:18:24.816 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-02-26T12:18:24.921 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-26T12:18:24.959 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.081+0000 7ff335973640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-26T12:18:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.081+0000 7ff335973640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-26T12:18:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.081+0000 7ff335973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-26T12:18:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.081+0000 7ff335973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-26T12:18:25.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.081+0000 7ff335973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-26T12:18:25.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:25.089+0000 7ff335973640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-26T12:18:27.924 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-26T12:18:27.956 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.061+0000 7f7c2cf49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.061+0000 7f7c2cf49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.061+0000 7f7c2cf49640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.061+0000 7f7c2cf49640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.061+0000 7f7c2cf49640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-26T12:18:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:28.062+0000 7f7c2cf49640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-26T12:18:30.904 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-26T12:18:30.935 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.042+0000 7fd8a1e48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.042+0000 7fd8a1e48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.042+0000 7fd8a1e48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.042+0000 7fd8a1e48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.042+0000 7fd8a1e48640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-26T12:18:31.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:31.043+0000 7fd8a1e48640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-26T12:18:33.880 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-26T12:18:33.911 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:34.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.018+0000 7ff292ddd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-26T12:18:34.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.018+0000 7ff292ddd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-26T12:18:34.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.018+0000 7ff292ddd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-26T12:18:34.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.018+0000 7ff292ddd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-26T12:18:34.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.018+0000 7ff292ddd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-26T12:18:34.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:34.019+0000 7ff292ddd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-26T12:18:36.855 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-26T12:18:36.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-26T12:18:36.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:36.919 INFO:tasks.ceph:role: osd.4 2024-02-26T12:18:36.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:18:36.919 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-26T12:18:36.997 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:36.997 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:36.997 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:36.997 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:36.997 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:36.998 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:36.998 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:36.999 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:36.999 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:36.999 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:37.520 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-26T12:18:37.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-26T12:18:37.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-02-26T12:18:37.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-26T12:18:37.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-26T12:18:37.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:37.749 INFO:tasks.ceph:role: osd.5 2024-02-26T12:18:37.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:18:37.749 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-26T12:18:37.824 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:37.825 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:38.282 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-26T12:18:38.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-26T12:18:38.284 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-26T12:18:38.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-26T12:18:38.405 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-26T12:18:38.473 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:38.473 INFO:tasks.ceph:role: osd.6 2024-02-26T12:18:38.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:18:38.473 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-26T12:18:38.547 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:38.548 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:39.039 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-26T12:18:39.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-26T12:18:39.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-26T12:18:39.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-26T12:18:39.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-26T12:18:39.271 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-02-26T12:18:39.271 INFO:tasks.ceph:role: osd.7 2024-02-26T12:18:39.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:18:39.271 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-26T12:18:39.345 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-26T12:18:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-26T12:18:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-26T12:18:39.346 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-26T12:18:39.869 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-02-26T12:18:39.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-02-26T12:18:39.871 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-02-26T12:18:40.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-26T12:18:40.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:40.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.153+0000 7f04ef613640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-26T12:18:40.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.154+0000 7f04ef613640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-26T12:18:40.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.154+0000 7f04ef613640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-26T12:18:40.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.154+0000 7f04ef613640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-26T12:18:40.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.154+0000 7f04ef613640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-26T12:18:40.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:40.155+0000 7f04ef613640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-26T12:18:42.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-26T12:18:43.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.135+0000 7fb272417640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.135+0000 7fb272417640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.135+0000 7fb272417640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.135+0000 7fb272417640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.135+0000 7fb272417640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-26T12:18:43.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:43.136+0000 7fb272417640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-26T12:18:45.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-26T12:18:46.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:46.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.111+0000 7f06fcb9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-26T12:18:46.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.112+0000 7f06fcb9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-26T12:18:46.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.112+0000 7f06fcb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-26T12:18:46.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.112+0000 7f06fcb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-26T12:18:46.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.112+0000 7f06fcb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-26T12:18:46.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:46.112+0000 7f06fcb9a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-26T12:18:48.394 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:48.397 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:18:48.946 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-26T12:18:48.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.077+0000 7fbfd2c37640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-26T12:18:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.078+0000 7fbfd2c37640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-26T12:18:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.078+0000 7fbfd2c37640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-26T12:18:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.078+0000 7fbfd2c37640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-26T12:18:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.078+0000 7fbfd2c37640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-26T12:18:49.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:49.078+0000 7fbfd2c37640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-26T12:18:51.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-26T12:18:51.944 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-26T12:18:51.944 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:51.944 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-26T12:18:51.980 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:51.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-26T12:18:52.050 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.050 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-26T12:18:52.119 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.120 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-26T12:18:52.188 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.188 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-26T12:18:52.256 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.256 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-26T12:18:52.324 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.324 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-26T12:18:52.392 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.392 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-26T12:18:52.424 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.424 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-26T12:18:52.494 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-26T12:18:52.564 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-26T12:18:52.633 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-26T12:18:52.701 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-26T12:18:52.769 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-26T12:18:52.836 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.836 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-26T12:18:52.854 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:52.854 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-02-26T12:18:52.911 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.911 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-02-26T12:18:52.926 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:52.926 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-02-26T12:18:52.981 INFO:tasks.ceph:Adding keys to all mons... 2024-02-26T12:18:52.981 DEBUG:teuthology.orchestra.run.smithi113:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-26T12:18:52.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-26T12:18:53.024 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.y] 2024-02-26T12:18:53.024 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCMgdxlwVdFOxAAN3iW1NzQNpMXBu1/VMunCQ== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlIUVWBxAAoIb7CiZ0h4TnUId3z+lWYA== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlHEWwDhAACHSnTDGIW7ir19BlP6z9CQ== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.0] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCRgdxlRx/nBBAAlWpF9a6IZHMlJsCirvPjhg== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.1] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCUgdxl00S7AxAAw7vI8+KmK1XxgrM4KIS48Q== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.2] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCXgdxlzlWVAhAAmWSHzmr7Mq6mOJuQ+bszNw== 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.3] 2024-02-26T12:18:53.025 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCagdxl9ikiARAAONErcGizNOuSv+AfEjlZ1Q== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.x] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxl5u7qAxAADD0FSvDiWWwt6s9RwaDbow== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlBdyyExAAm7/XW6ucVqLy/GTXhq5aVA== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxl0/MOGxAAlLlajH3IYY+shV+XCK3slg== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.4] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCggdxlCwAyCRAAsQ4cnnXYVh1wIW/+PWunUQ== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.5] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCjgdxlTm0hCBAANHh2E/pki0/6nXks9fr9oA== 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.6] 2024-02-26T12:18:53.026 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCmgdxlFHy7BhAAJUNm7DiInx3+m9u7IVyK3A== 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.7] 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCpgdxlzsy0BBAAOh/fIEw/eIbxJl9pbLAd1g== 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlPw+IHxAAOkKN2ANdXBNLAJL0n0jDGw== 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout:[client.2] 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlvRhLJRAAY4uf22Sf4sVhx+wgfkfgpw== 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout:[client.1] 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlLFCzKBAANfNh6C1RYTyf4vMEYWLdsQ== 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout:[client.3] 2024-02-26T12:18:53.027 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlHOOALhAACszlhRajx7N0H/roUlBEMw== 2024-02-26T12:18:53.046 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-02-26T12:18:53.046 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCMgdxlwVdFOxAAN3iW1NzQNpMXBu1/VMunCQ== 2024-02-26T12:18:53.046 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-02-26T12:18:53.046 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlIUVWBxAAoIb7CiZ0h4TnUId3z+lWYA== 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlHEWwDhAACHSnTDGIW7ir19BlP6z9CQ== 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCRgdxlRx/nBBAAlWpF9a6IZHMlJsCirvPjhg== 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCUgdxl00S7AxAAw7vI8+KmK1XxgrM4KIS48Q== 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCXgdxlzlWVAhAAmWSHzmr7Mq6mOJuQ+bszNw== 2024-02-26T12:18:53.047 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCagdxl9ikiARAAONErcGizNOuSv+AfEjlZ1Q== 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxl5u7qAxAADD0FSvDiWWwt6s9RwaDbow== 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlBdyyExAAm7/XW6ucVqLy/GTXhq5aVA== 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxl0/MOGxAAlLlajH3IYY+shV+XCK3slg== 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCggdxlCwAyCRAAsQ4cnnXYVh1wIW/+PWunUQ== 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-02-26T12:18:53.048 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCjgdxlTm0hCBAANHh2E/pki0/6nXks9fr9oA== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCmgdxlFHy7BhAAJUNm7DiInx3+m9u7IVyK3A== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCpgdxlzsy0BBAAOh/fIEw/eIbxJl9pbLAd1g== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlPw+IHxAAOkKN2ANdXBNLAJL0n0jDGw== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlvRhLJRAAY4uf22Sf4sVhx+wgfkfgpw== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlLFCzKBAANfNh6C1RYTyf4vMEYWLdsQ== 2024-02-26T12:18:53.049 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2024-02-26T12:18:53.050 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCNgdxlHOOALhAACszlhRajx7N0H/roUlBEMw== 2024-02-26T12:18:53.051 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-26T12:18:53.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-26T12:18:53.143 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.145 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.204 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.261 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.315 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.369 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.371 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.423 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.478 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-26T12:18:53.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-26T12:18:53.532 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-26T12:18:53.646 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.700 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.703 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.756 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.810 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-26T12:18:53.864 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:53.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:53.921 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:53.924 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:53.979 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:53.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:54.037 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:54.039 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-26T12:18:54.094 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-26T12:18:54.094 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-26T12:18:54.120 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-26T12:18:54.217 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-26T12:18:54.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-26T12:18:54.271 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-26T12:18:54.368 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-26T12:18:54.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-26T12:18:54.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-26T12:18:54.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-26T12:18:54.585 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:54.587 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-26T12:18:54.640 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-26T12:18:54.640 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-26T12:18:54.640 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-26T12:18:54.642 INFO:tasks.ceph.mon.a:Started 2024-02-26T12:18:54.643 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-26T12:18:54.643 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-26T12:18:54.682 INFO:tasks.ceph.mon.b:Started 2024-02-26T12:18:54.683 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-26T12:18:54.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-26T12:18:54.685 INFO:tasks.ceph.mon.c:Started 2024-02-26T12:18:54.685 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-26T12:18:54.685 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-26T12:18:54.685 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-26T12:18:54.687 INFO:tasks.ceph.mgr.y:Started 2024-02-26T12:18:54.688 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-26T12:18:54.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-26T12:18:54.690 INFO:tasks.ceph.mgr.x:Started 2024-02-26T12:18:54.690 INFO:tasks.ceph:Setting crush tunables to default 2024-02-26T12:18:54.690 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd crush tunables default 2024-02-26T12:18:54.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 Processor -- start 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 -- start start 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f561c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c099d70 con 0x7f561c0cd4c0 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c099b20 con 0x7f561c15ba50 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5623111640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c09a050 con 0x7f561c15be30 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44694/0 (socket says 172.21.15.113:44694) 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 learned_addr learned my addr 172.21.15.113:0/2256493818 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 msgr2=0x7f561c09ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 msgr2=0x7f561c09ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.806+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-26T12:18:54.793 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f561bfff640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f561c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f561bfff640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 msgr2=0x7f561c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-26T12:18:54.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f561bfff640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 msgr2=0x7f561c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-26T12:18:54.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f561bfff640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f561c0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-26T12:18:54.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.807+0000 7f561bfff640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f561c0ccf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-26T12:18:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.985+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851195463 0 0) 0x7f561c099d70 con 0x7f561c0cd4c0 2024-02-26T12:18:54.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.985+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f560c003520 con 0x7f561c0cd4c0 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 705119545 0 0) 0x7f560c003520 con 0x7f561c0cd4c0 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 msgr2=0x7f561c0ccf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f561c0ccf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 msgr2=0x7f561c09ab30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 --2- 172.21.15.113:0/2256493818 >> v2:172.21.15.113:3300/0 conn(0x7f561c15ba50 0x7f561c09ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c09a330 con 0x7f561c0cd4c0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f56140019f0 con 0x7f561c0cd4c0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 >> v1:172.21.15.152:6789/0 conn(0x7f561c0cd4c0 legacy=0x7f561c0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c004800 0x7f560c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f560c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c099b20 con 0x7f560c0039b0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c09a050 con 0x7f560c004800 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.991+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c00bac0 con 0x7f561c15be30 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f561bfff640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c004800 0x7f560c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f56216ae640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f560c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 msgr2=0x7f560c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c15be30 0x7f560c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c004800 msgr2=0x7f560c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:54.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c004800 0x7f560c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.992+0000 7f5620ead640 1 -- 172.21.15.113:0/2256493818 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c003520 con 0x7f560c0039b0 2024-02-26T12:18:54.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5620ead640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5610009100 tx=0x7f560c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66867fbff641dee9 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:54.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610034070 con 0x7f560c0039b0 2024-02-26T12:18:54.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610030630 con 0x7f560c0039b0 2024-02-26T12:18:54.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f561b7fe640 1 -- 172.21.15.113:0/2256493818 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000f040 con 0x7f560c0039b0 2024-02-26T12:18:54.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5623111640 1 -- 172.21.15.113:0/2256493818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f560c0039b0 msgr2=0x7f560c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:54.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5623111640 1 --2- 172.21.15.113:0/2256493818 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f560c0039b0 0x7f560c003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5610009100 tx=0x7f560c005830 comp rx=0 tx=0).stop 2024-02-26T12:18:54.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f56216ae640 1 -- 172.21.15.113:0/2256493818 reap_dead start 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5623111640 1 -- 172.21.15.113:0/2256493818 shutdown_connections 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5623111640 1 -- 172.21.15.113:0/2256493818 >> 172.21.15.113:0/2256493818 conn(0x7f561c0b3450 msgr2=0x7f561c0b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.993+0000 7f5623111640 1 -- 172.21.15.113:0/2256493818 shutdown_connections 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.994+0000 7f5623111640 1 -- 172.21.15.113:0/2256493818 wait complete. 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.995+0000 7f5623111640 1 Processor -- start 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.995+0000 7f5623111640 1 -- start start 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c0039b0 0x7f561c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c0c9d80 0x7f561c148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0d0650 con 0x7f561c0c75e0 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0cf6f0 con 0x7f560c0039b0 2024-02-26T12:18:54.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0d07d0 con 0x7f561c0c9d80 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44744/0 (socket says 172.21.15.113:44744) 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 -- 172.21.15.113:0/2344522605 learned_addr learned my addr 172.21.15.113:0/2344522605 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5620ead640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c0039b0 0x7f561c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f56216ae640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c0c9d80 0x7f561c148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 -- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c0c9d80 msgr2=0x7f561c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c0c9d80 0x7f561c148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 -- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c0039b0 msgr2=0x7f561c0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c0039b0 0x7f561c0cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 -- 172.21.15.113:0/2344522605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0ca300 con 0x7f561c0c75e0 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f561bfff640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56080108d0 tx=0x7f5608010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:54.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560801a020 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800e9c0 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c0ca5e0 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800edb0 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.996+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c0caba0 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.997+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f560801d020 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.997+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56080149f0 con 0x7f561c0c75e0 2024-02-26T12:18:54.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.997+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c074a50 con 0x7f561c0c75e0 2024-02-26T12:18:54.987 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:54.999+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5608024020 con 0x7f561c0c75e0 2024-02-26T12:18:55.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.067+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f561c0cffe0 con 0x7f561c0c75e0 2024-02-26T12:18:55.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.068+0000 7f56197fa640 1 -- 172.21.15.113:0/2344522605 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5608014430 con 0x7f561c0c75e0 2024-02-26T12:18:55.054 INFO:teuthology.orchestra.run.smithi113.stderr:adjusted tunables profile to default 2024-02-26T12:18:55.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 msgr2=0x7f561c0c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56080108d0 tx=0x7f5608010d90 comp rx=0 tx=0).stop 2024-02-26T12:18:55.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 shutdown_connections 2024-02-26T12:18:55.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f561c0c9d80 0x7f561c148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f561c0c75e0 0x7f561c0c9840 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 --2- 172.21.15.113:0/2344522605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f560c0039b0 0x7f561c0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 >> 172.21.15.113:0/2344522605 conn(0x7f561c0b3450 msgr2=0x7f561c0cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:55.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 shutdown_connections 2024-02-26T12:18:55.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:55.070+0000 7f5623111640 1 -- 172.21.15.113:0/2344522605 wait complete. 2024-02-26T12:18:55.069 INFO:tasks.ceph:check_enable_crimson: False 2024-02-26T12:18:55.069 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-26T12:18:55.069 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:55.069 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-26T12:18:55.096 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:55.096 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-26T12:18:55.163 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:55.163 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-26T12:18:55.232 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:18:55.232 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-26T12:18:55.299 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:55.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-26T12:18:55.329 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:55.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-26T12:18:55.396 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:55.396 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-26T12:18:55.441 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:55.456+0000 7f5c84612040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-26T12:18:55.463 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:18:55.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-26T12:18:55.466 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:55.481+0000 7f17d3c2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-26T12:18:55.492 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a 0 2024-02-26T12:18:55.495 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:55.510+0000 7f5c84612040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-26T12:18:55.522 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:55.537+0000 7f17d3c2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-26T12:18:55.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.637+0000 7f6eb26de640 1 Processor -- start 2024-02-26T12:18:55.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.637+0000 7f6eb26de640 1 -- start start 2024-02-26T12:18:55.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb26de640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 0x7f6eac0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb26de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 0x7f6eac15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb26de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0cbf20 con 0x7f6eac15adb0 2024-02-26T12:18:55.624 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb26de640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0cc200 con 0x7f6eac15a9d0 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb26de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0cc4e0 con 0x7f6eac0cba70 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb0c7b640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 0x7f6eac15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eab7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6eac15adb0 0x7f6eac0cb360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38904/0 (socket says 172.21.15.152:38904) 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eab7fe640 1 -- 172.21.15.152:0/3480986736 learned_addr learned my addr 172.21.15.152:0/3480986736 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eabfff640 1 --2- 172.21.15.152:0/3480986736 >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 0x7f6eac0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb0c7b640 1 -- 172.21.15.152:0/3480986736 >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 msgr2=0x7f6eac0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb0c7b640 1 --2- 172.21.15.152:0/3480986736 >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 0x7f6eac0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb0c7b640 1 -- 172.21.15.152:0/3480986736 >> v1:172.21.15.152:6789/0 conn(0x7f6eac15adb0 legacy=0x7f6eac0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eaaffd640 1 -- 172.21.15.152:0/3480986736 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294317481 0 0) 0x7f6eac0cbf20 con 0x7f6eac15adb0 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eb0c7b640 1 -- 172.21.15.152:0/3480986736 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0ce5c0 con 0x7f6eac0cba70 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.638+0000 7f6eabfff640 1 --2- 172.21.15.152:0/3480986736 >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 0x7f6eac0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eb0c7b640 1 --2- 172.21.15.152:0/3480986736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 0x7f6eac15e6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009d90 tx=0x7f6ea402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afbf99c1d935533 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:55.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eaaffd640 1 -- 172.21.15.152:0/3480986736 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4039070 con 0x7f6eac0cba70 2024-02-26T12:18:55.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eaaffd640 1 -- 172.21.15.152:0/3480986736 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea402cc50 con 0x7f6eac0cba70 2024-02-26T12:18:55.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eaaffd640 1 -- 172.21.15.152:0/3480986736 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4034440 con 0x7f6eac0cba70 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eb26de640 1 -- 172.21.15.152:0/3480986736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 msgr2=0x7f6eac15e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.639+0000 7f6eb26de640 1 --2- 172.21.15.152:0/3480986736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 0x7f6eac15e6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009d90 tx=0x7f6ea402bea0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 -- 172.21.15.152:0/3480986736 shutdown_connections 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 --2- 172.21.15.152:0/3480986736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac0cba70 0x7f6eac15e6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 --2- 172.21.15.152:0/3480986736 >> v2:172.21.15.113:3300/0 conn(0x7f6eac15a9d0 0x7f6eac0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 -- 172.21.15.152:0/3480986736 >> 172.21.15.152:0/3480986736 conn(0x7f6eac099a40 msgr2=0x7f6eac0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 -- 172.21.15.152:0/3480986736 shutdown_connections 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.640+0000 7f6eb26de640 1 -- 172.21.15.152:0/3480986736 wait complete. 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.641+0000 7f6eb26de640 1 Processor -- start 2024-02-26T12:18:55.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.641+0000 7f6eb26de640 1 -- start start 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 0x7f6eac06adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 0x7f6eac1f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac15ed80 con 0x7f6eac15adb0 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac15ec00 con 0x7f6eac0cba70 2024-02-26T12:18:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb26de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac15ef00 con 0x7f6eac15a9d0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 0x7f6eac06adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eabfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54954/0 (socket says 172.21.15.152:54954) 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eabfff640 1 -- 172.21.15.152:0/166974078 learned_addr learned my addr 172.21.15.152:0/166974078 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb0c7b640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 0x7f6eac1f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 -- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 msgr2=0x7f6eac0c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 -- 172.21.15.152:0/166974078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 msgr2=0x7f6eac1f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 0x7f6eac1f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 -- 172.21.15.152:0/166974078 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0c6ed0 con 0x7f6eac15a9d0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eabfff640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eb0c7b640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 0x7f6eac1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.642+0000 7f6eab7fe640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 0x7f6eac06adc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6eac073430 tx=0x7f6e9c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:55.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c017070 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c005ce0 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac0c6910 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0072f0 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac0b3740 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6e9c01a070 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.643+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6e9c012740 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.644+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac068180 con 0x7f6eac15a9d0 2024-02-26T12:18:55.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.646+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6e9c021020 con 0x7f6eac15a9d0 2024-02-26T12:18:55.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.717+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a", "id": 0} v 0) v1 -- 0x7f6eac074a50 con 0x7f6eac15a9d0 2024-02-26T12:18:55.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.723+0000 7f6ea8ff9640 1 -- 172.21.15.152:0/166974078 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e9c0075e0 con 0x7f6eac15a9d0 2024-02-26T12:18:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:0 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 msgr2=0x7f6eac06adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 0x7f6eac06adc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6eac073430 tx=0x7f6e9c00c8e0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 shutdown_connections 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6eac15adb0 0x7f6eac1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6eac15a9d0 0x7f6eac06adc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 --2- 172.21.15.152:0/166974078 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6eac0cba70 0x7f6eac0c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 >> 172.21.15.152:0/166974078 conn(0x7f6eac099a40 msgr2=0x7f6eac0cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 shutdown_connections 2024-02-26T12:18:55.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.724+0000 7f6eb26de640 1 -- 172.21.15.152:0/166974078 wait complete. 2024-02-26T12:18:55.720 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new f6116b70-0a14-4ddc-9bd4-53360e938106 1 2024-02-26T12:18:55.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.834+0000 7fbb4c4d5640 1 Processor -- start 2024-02-26T12:18:55.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.834+0000 7fbb4c4d5640 1 -- start start 2024-02-26T12:18:55.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4c4d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4c4d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbb440cff40 0x7fbb440d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4c4d5640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb44099d70 con 0x7fbb4415ba50 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4c4d5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb440d08f0 con 0x7fbb440cff40 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4c4d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44099b20 con 0x7fbb4415be30 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53316/0 (socket says 172.21.15.152:53316) 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 -- 172.21.15.152:0/2823171714 learned_addr learned my addr 172.21.15.152:0/2823171714 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb4aa72640 1 --2- 172.21.15.152:0/2823171714 >> v2:172.21.15.113:3300/0 conn(0x7fbb440cff40 0x7fbb440d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 -- 172.21.15.152:0/2823171714 >> v2:172.21.15.113:3300/0 conn(0x7fbb440cff40 msgr2=0x7fbb440d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 --2- 172.21.15.152:0/2823171714 >> v2:172.21.15.113:3300/0 conn(0x7fbb440cff40 0x7fbb440d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 -- 172.21.15.152:0/2823171714 >> v1:172.21.15.113:6789/0 conn(0x7fbb4415ba50 legacy=0x7fbb440ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.835+0000 7fbb49a70640 1 -- 172.21.15.152:0/2823171714 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4409a050 con 0x7fbb4415be30 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.836+0000 7fbb49a70640 1 --2- 172.21.15.152:0/2823171714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b4f0447d40a7faa server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.836+0000 7fbb4926f640 1 -- 172.21.15.152:0/2823171714 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40034070 con 0x7fbb4415be30 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.836+0000 7fbb4926f640 1 -- 172.21.15.152:0/2823171714 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40030840 con 0x7fbb4415be30 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.836+0000 7fbb4926f640 1 -- 172.21.15.152:0/2823171714 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40030c10 con 0x7fbb4415be30 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/2823171714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 msgr2=0x7fbb4409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/2823171714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002b980 comp rx=0 tx=0).stop 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/2823171714 shutdown_connections 2024-02-26T12:18:55.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/2823171714 >> v2:172.21.15.113:3300/0 conn(0x7fbb440cff40 0x7fbb440d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/2823171714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb4415be30 0x7fbb4409ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/2823171714 >> 172.21.15.152:0/2823171714 conn(0x7fbb440b3450 msgr2=0x7fbb440b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:55.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/2823171714 shutdown_connections 2024-02-26T12:18:55.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.837+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/2823171714 wait complete. 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.838+0000 7fbb4c4d5640 1 Processor -- start 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.838+0000 7fbb4c4d5640 1 -- start start 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 0x7fbb44157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440cf6f0 con 0x7fbb4415be30 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4409a610 con 0x7fbb4415ba50 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb440cd690 con 0x7fbb440cff40 2024-02-26T12:18:55.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4a271640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54956/0 (socket says 172.21.15.152:54956) 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4a271640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53324/0 (socket says 172.21.15.152:53324) 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 -- 172.21.15.152:0/552366413 learned_addr learned my addr 172.21.15.152:0/552366413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4aa72640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 0x7fbb44157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 -- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 msgr2=0x7fbb440b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 -- 172.21.15.152:0/552366413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 msgr2=0x7fbb44157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 0x7fbb44157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 -- 172.21.15.152:0/552366413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44152140 con 0x7fbb4415ba50 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4a271640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:55.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4aa72640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 0x7fbb44157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb49a70640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c00 tx=0x7fbb40004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40048070 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40030640 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb44156220 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.839+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40034040 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.840+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb441567e0 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.840+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbb4004b070 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.840+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fbb40043410 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.840+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb44074a50 con 0x7fbb4415ba50 2024-02-26T12:18:55.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.842+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbb40052070 con 0x7fbb4415ba50 2024-02-26T12:18:55.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.915+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f6116b70-0a14-4ddc-9bd4-53360e938106", "id": 1} v 0) v1 -- 0x7fbb4415cb60 con 0x7fbb4415ba50 2024-02-26T12:18:55.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.922+0000 7fbb3affd640 1 -- 172.21.15.152:0/552366413 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6116b70-0a14-4ddc-9bd4-53360e938106", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb44152140 con 0x7fbb4415ba50 2024-02-26T12:18:55.908 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 msgr2=0x7fbb441506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb40000c00 tx=0x7fbb40004730 comp rx=0 tx=0).stop 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 shutdown_connections 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb4415be30 0x7fbb44157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb4415ba50 0x7fbb441506e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 --2- 172.21.15.152:0/552366413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb440cff40 0x7fbb440b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 >> 172.21.15.152:0/552366413 conn(0x7fbb440b3450 msgr2=0x7fbb440cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:55.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 shutdown_connections 2024-02-26T12:18:55.910 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:55.923+0000 7fbb4c4d5640 1 -- 172.21.15.152:0/552366413 wait complete. 2024-02-26T12:18:55.919 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 690d29c3-8e30-4279-b1bc-45eab0e3476f 2 2024-02-26T12:18:56.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.035+0000 7fdb1c0a6640 1 Processor -- start 2024-02-26T12:18:56.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.036+0000 7fdb1c0a6640 1 -- start start 2024-02-26T12:18:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.036+0000 7fdb1c0a6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb1415adb0 0x7fdb140b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.036+0000 7fdb1c0a6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140cbf20 con 0x7fdb140cba70 2024-02-26T12:18:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.036+0000 7fdb1c0a6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140cc200 con 0x7fdb1415a9d0 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.036+0000 7fdb1c0a6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140cc4e0 con 0x7fdb1415adb0 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb19e42640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdb1415a9d0 0x7fdb140cb360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38920/0 (socket says 172.21.15.152:38920) 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb19e42640 1 -- 172.21.15.152:0/544327103 learned_addr learned my addr 172.21.15.152:0/544327103 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb1a643640 1 --2- 172.21.15.152:0/544327103 >> v2:172.21.15.113:3300/0 conn(0x7fdb1415adb0 0x7fdb140b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb18e40640 1 -- 172.21.15.152:0/544327103 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242813028 0 0) 0x7fdb140cc200 con 0x7fdb1415a9d0 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb18e40640 1 -- 172.21.15.152:0/544327103 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb00003520 con 0x7fdb1415a9d0 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb1a643640 1 -- 172.21.15.152:0/544327103 >> v1:172.21.15.152:6789/0 conn(0x7fdb1415a9d0 legacy=0x7fdb140cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb1a643640 1 -- 172.21.15.152:0/544327103 >> v1:172.21.15.113:6789/0 conn(0x7fdb140cba70 legacy=0x7fdb1415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.037+0000 7fdb1a643640 1 -- 172.21.15.152:0/544327103 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140ce5c0 con 0x7fdb1415adb0 2024-02-26T12:18:56.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.038+0000 7fdb1a643640 1 --2- 172.21.15.152:0/544327103 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b00e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00bfa0 tx=0x7fdb0c02e140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df3c3b665a2faf server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.038+0000 7fdb18e40640 1 -- 172.21.15.152:0/544327103 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c02eae0 con 0x7fdb1415adb0 2024-02-26T12:18:56.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.038+0000 7fdb18e40640 1 -- 172.21.15.152:0/544327103 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c02ec80 con 0x7fdb1415adb0 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.038+0000 7fdb18e40640 1 -- 172.21.15.152:0/544327103 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c009760 con 0x7fdb1415adb0 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/544327103 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 msgr2=0x7fdb140b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/544327103 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b00e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00bfa0 tx=0x7fdb0c02e140 comp rx=0 tx=0).stop 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/544327103 shutdown_connections 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/544327103 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b00e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/544327103 >> 172.21.15.152:0/544327103 conn(0x7fdb14099a40 msgr2=0x7fdb140d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/544327103 shutdown_connections 2024-02-26T12:18:56.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.039+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/544327103 wait complete. 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.040+0000 7fdb1c0a6640 1 Processor -- start 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.040+0000 7fdb1c0a6640 1 -- start start 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1415ef50 con 0x7fdb1415adb0 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1415edd0 con 0x7fdb1415a9d0 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140ceae0 con 0x7fdb140cba70 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19641640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19e42640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19e42640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53340/0 (socket says 172.21.15.152:53340) 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19641640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54960/0 (socket says 172.21.15.152:54960) 2024-02-26T12:18:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19e42640 1 -- 172.21.15.152:0/1519826163 learned_addr learned my addr 172.21.15.152:0/1519826163 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 -- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 msgr2=0x7fdb140c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 -- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 msgr2=0x7fdb140b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 -- 172.21.15.152:0/1519826163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140b4500 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19e42640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb19641640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1a643640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b6220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb1406e370 tx=0x7fdb0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00b660 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c045070 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb140b47e0 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.041+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c040880 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.042+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb140b4da0 con 0x7fdb1415adb0 2024-02-26T12:18:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.042+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdb0c040a20 con 0x7fdb1415adb0 2024-02-26T12:18:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.042+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdb0c04ad30 con 0x7fdb1415adb0 2024-02-26T12:18:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.042+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb14068180 con 0x7fdb1415adb0 2024-02-26T12:18:56.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.045+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdb0c04a460 con 0x7fdb1415adb0 2024-02-26T12:18:56.033 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.048+0000 7f5c84612040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-26T12:18:56.080 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.094+0000 7f17d3c2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-26T12:18:56.087 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.102+0000 7f5c84612040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-26T12:18:56.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.116+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd new", "uuid": "690d29c3-8e30-4279-b1bc-45eab0e3476f", "id": 2} v 0) v1 -- 0x7fdb14074a50 con 0x7fdb1415adb0 2024-02-26T12:18:56.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.118+0000 7fdb0a7fc640 1 -- 172.21.15.152:0/1519826163 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "690d29c3-8e30-4279-b1bc-45eab0e3476f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb0c02eb60 con 0x7fdb1415adb0 2024-02-26T12:18:56.103 INFO:teuthology.orchestra.run.smithi152.stdout:2 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 msgr2=0x7fdb140b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b6220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb1406e370 tx=0x7fdb0c004a40 comp rx=0 tx=0).stop 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 shutdown_connections 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb1415adb0 0x7fdb140b6220 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1415a9d0 0x7fdb140b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 --2- 172.21.15.152:0/1519826163 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb140cba70 0x7fdb140c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 >> 172.21.15.152:0/1519826163 conn(0x7fdb14099a40 msgr2=0x7fdb140ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 shutdown_connections 2024-02-26T12:18:56.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.119+0000 7fdb1c0a6640 1 -- 172.21.15.152:0/1519826163 wait complete. 2024-02-26T12:18:56.115 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new ca0ec18b-2307-4b89-a95c-2394cf1a919c 3 2024-02-26T12:18:56.132 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.147+0000 7f5c84612040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-26T12:18:56.138 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.152+0000 7f17d3c2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-26T12:18:56.185 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.200+0000 7f17d3c2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-26T12:18:56.186 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.200+0000 7f5c84612040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-26T12:18:56.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 Processor -- start 2024-02-26T12:18:56.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 -- start start 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 0x7efbf80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf80cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80cbf20 con 0x7efbf80cb8a0 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80cbcf0 con 0x7efbf815a9d0 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.230+0000 7efbfd0de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80cc200 con 0x7efbf815adb0 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf659c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf80cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf6d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 0x7efbf80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf759e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efbf80cb8a0 0x7efbf815e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38932/0 (socket says 172.21.15.152:38932) 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf759e640 1 -- 172.21.15.152:0/2564910512 learned_addr learned my addr 172.21.15.152:0/2564910512 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf659c640 1 -- 172.21.15.152:0/2564910512 >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 msgr2=0x7efbf80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf659c640 1 --2- 172.21.15.152:0/2564910512 >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 0x7efbf80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf659c640 1 -- 172.21.15.152:0/2564910512 >> v1:172.21.15.152:6789/0 conn(0x7efbf80cb8a0 legacy=0x7efbf815e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf659c640 1 -- 172.21.15.152:0/2564910512 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80cc4e0 con 0x7efbf815adb0 2024-02-26T12:18:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf5d9b640 1 -- 172.21.15.152:0/2564910512 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959773514 0 0) 0x7efbf80cbf20 con 0x7efbf80cb8a0 2024-02-26T12:18:56.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.231+0000 7efbf6d9d640 1 --2- 172.21.15.152:0/2564910512 >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 0x7efbf80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.232+0000 7efbf659c640 1 --2- 172.21.15.152:0/2564910512 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf80cb360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097a0 tx=0x7efbec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d1afc5138f43ef server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.232+0000 7efbf5d9b640 1 -- 172.21.15.152:0/2564910512 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec035020 con 0x7efbf815adb0 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.232+0000 7efbf5d9b640 1 -- 172.21.15.152:0/2564910512 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec031830 con 0x7efbf815adb0 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.232+0000 7efbf5d9b640 1 -- 172.21.15.152:0/2564910512 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec031c00 con 0x7efbf815adb0 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 -- 172.21.15.152:0/2564910512 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 msgr2=0x7efbf80cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 --2- 172.21.15.152:0/2564910512 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf80cb360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097a0 tx=0x7efbec02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 -- 172.21.15.152:0/2564910512 shutdown_connections 2024-02-26T12:18:56.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 --2- 172.21.15.152:0/2564910512 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf80cb360 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 --2- 172.21.15.152:0/2564910512 >> v2:172.21.15.152:3300/0 conn(0x7efbf815a9d0 0x7efbf80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 -- 172.21.15.152:0/2564910512 >> 172.21.15.152:0/2564910512 conn(0x7efbf8099a40 msgr2=0x7efbf80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 -- 172.21.15.152:0/2564910512 shutdown_connections 2024-02-26T12:18:56.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.233+0000 7efbfd0de640 1 -- 172.21.15.152:0/2564910512 wait complete. 2024-02-26T12:18:56.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.234+0000 7efbfd0de640 1 Processor -- start 2024-02-26T12:18:56.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.234+0000 7efbfd0de640 1 -- start start 2024-02-26T12:18:56.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efbf80cb8a0 0x7efbf814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf8153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80afd90 con 0x7efbf80cb8a0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf815edd0 con 0x7efbf815a9d0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbfd0de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf815e030 con 0x7efbf815adb0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf759e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf8153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54974/0 (socket says 172.21.15.152:54974) 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 -- 172.21.15.152:0/1190504102 learned_addr learned my addr 172.21.15.152:0/1190504102 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf6d9d640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efbf80cb8a0 0x7efbf814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 -- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 msgr2=0x7efbf8153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf8153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 -- 172.21.15.152:0/1190504102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efbf80cb8a0 msgr2=0x7efbf814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efbf80cb8a0 0x7efbf814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf659c640 1 -- 172.21.15.152:0/1190504102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8154c40 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.235+0000 7efbf759e640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf8153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbf659c640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efbec0098c0 tx=0x7efbec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec040070 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec03e070 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf8154ee0 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec035040 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf8153360 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efbec038020 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.236+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7efbec04e880 con 0x7efbf815a9d0 2024-02-26T12:18:56.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.237+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf8068180 con 0x7efbf815a9d0 2024-02-26T12:18:56.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.239+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efbec04e3f0 con 0x7efbf815a9d0 2024-02-26T12:18:56.228 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.243+0000 7f5c84612040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-26T12:18:56.242 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.257+0000 7f17d3c2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-26T12:18:56.285 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.299+0000 7f17d3c2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-26T12:18:56.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.309+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca0ec18b-2307-4b89-a95c-2394cf1a919c", "id": 3} v 0) v1 -- 0x7efbf80b67d0 con 0x7efbf815a9d0 2024-02-26T12:18:56.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.312+0000 7efbdf7fe640 1 -- 172.21.15.152:0/1190504102 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca0ec18b-2307-4b89-a95c-2394cf1a919c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7efbec04e650 con 0x7efbf815a9d0 2024-02-26T12:18:56.297 INFO:teuthology.orchestra.run.smithi152.stdout:3 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 msgr2=0x7efbf8154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efbec0098c0 tx=0x7efbec0046c0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 shutdown_connections 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efbf815adb0 0x7efbf8153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efbf815a9d0 0x7efbf8154700 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 --2- 172.21.15.152:0/1190504102 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efbf80cb8a0 0x7efbf814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 >> 172.21.15.152:0/1190504102 conn(0x7efbf8099a40 msgr2=0x7efbf806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 shutdown_connections 2024-02-26T12:18:56.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.313+0000 7efbfd0de640 1 -- 172.21.15.152:0/1190504102 wait complete. 2024-02-26T12:18:56.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 71957897-b9e1-4a3b-88c3-48f02bfa28d3 4 2024-02-26T12:18:56.344 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.358+0000 7f5c84612040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-26T12:18:56.406 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.421+0000 7f17d3c2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-26T12:18:56.413 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.428+0000 7f5c84612040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-26T12:18:56.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.463+0000 7f47af955640 1 Processor -- start 2024-02-26T12:18:56.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.463+0000 7f47af955640 1 -- start start 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47af955640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47a815be30 0x7f47a809ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47af955640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a8099d70 con 0x7f47a80cff40 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47af955640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a809a050 con 0x7f47a815ba50 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47af955640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a8099b20 con 0x7f47a815be30 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47a815be30 0x7f47a809ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47a815be30 0x7f47a809ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54984/0 (socket says 172.21.15.152:54984) 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 -- 172.21.15.152:0/1349177722 learned_addr learned my addr 172.21.15.152:0/1349177722 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47ad6f1640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f47a815ba50 0x7f47a80ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38938/0 (socket says 172.21.15.152:38938) 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 -- 172.21.15.152:0/1349177722 >> v1:172.21.15.152:6789/0 conn(0x7f47a815ba50 legacy=0x7f47a80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 -- 172.21.15.152:0/1349177722 >> v1:172.21.15.113:6789/0 conn(0x7f47a80cff40 legacy=0x7f47a80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.464+0000 7f47acef0640 1 -- 172.21.15.152:0/1349177722 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a809a330 con 0x7f47a815be30 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.465+0000 7f47acef0640 1 --2- 172.21.15.152:0/1349177722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815be30 0x7f47a809ab30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47a8099ca0 tx=0x7f47a402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb26a3bb5f13493 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.465+0000 7f479ffff640 1 -- 172.21.15.152:0/1349177722 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a402f840 con 0x7f47a815be30 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.465+0000 7f479ffff640 1 -- 172.21.15.152:0/1349177722 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a402f9e0 con 0x7f47a815be30 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.465+0000 7f479ffff640 1 -- 172.21.15.152:0/1349177722 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a402fdb0 con 0x7f47a815be30 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 -- 172.21.15.152:0/1349177722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815be30 msgr2=0x7f47a809ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 --2- 172.21.15.152:0/1349177722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815be30 0x7f47a809ab30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47a8099ca0 tx=0x7f47a402ba20 comp rx=0 tx=0).stop 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 -- 172.21.15.152:0/1349177722 shutdown_connections 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 --2- 172.21.15.152:0/1349177722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815be30 0x7f47a809ab30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 -- 172.21.15.152:0/1349177722 >> 172.21.15.152:0/1349177722 conn(0x7f47a80b3450 msgr2=0x7f47a80b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 -- 172.21.15.152:0/1349177722 shutdown_connections 2024-02-26T12:18:56.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.466+0000 7f47af955640 1 -- 172.21.15.152:0/1349177722 wait complete. 2024-02-26T12:18:56.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.468+0000 7f47af955640 1 Processor -- start 2024-02-26T12:18:56.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.468+0000 7f47af955640 1 -- start start 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47a80cff40 0x7f47a8154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a815be30 0x7f47a8157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80cd690 con 0x7f47a815be30 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80cf6f0 con 0x7f47a815ba50 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47af955640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80b6480 con 0x7f47a80cff40 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47ad6f1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47a80cff40 0x7f47a8154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47acef0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47acef0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54986/0 (socket says 172.21.15.152:54986) 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47acef0640 1 -- 172.21.15.152:0/1863036634 learned_addr learned my addr 172.21.15.152:0/1863036634 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47adef2640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a815be30 0x7f47a8157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.469+0000 7f47acef0640 1 -- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47a80cff40 msgr2=0x7f47a8154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47acef0640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47a80cff40 0x7f47a8154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47acef0640 1 -- 172.21.15.152:0/1863036634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a815be30 msgr2=0x7f47a8157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47acef0640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a815be30 0x7f47a8157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47acef0640 1 -- 172.21.15.152:0/1863036634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80b53e0 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47acef0640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47a4000c00 tx=0x7f47a4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4046070 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4041440 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4041830 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80b56c0 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a80b5c80 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f47a4049070 con 0x7f47a815ba50 2024-02-26T12:18:56.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.470+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f47a40408f0 con 0x7f47a815ba50 2024-02-26T12:18:56.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.471+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8074a50 con 0x7f47a815ba50 2024-02-26T12:18:56.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.473+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f47a4050070 con 0x7f47a815ba50 2024-02-26T12:18:56.459 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.474+0000 7f5c84612040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-26T12:18:56.480 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.495+0000 7f17d3c2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-26T12:18:56.511 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.526+0000 7f5c84612040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-26T12:18:56.526 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.541+0000 7f17d3c2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-26T12:18:56.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.544+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71957897-b9e1-4a3b-88c3-48f02bfa28d3", "id": 4} v 0) v1 -- 0x7f47a815f090 con 0x7f47a815ba50 2024-02-26T12:18:56.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.547+0000 7f479dffb640 1 -- 172.21.15.152:0/1863036634 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71957897-b9e1-4a3b-88c3-48f02bfa28d3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47a4033030 con 0x7f47a815ba50 2024-02-26T12:18:56.532 INFO:teuthology.orchestra.run.smithi152.stdout:4 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 msgr2=0x7f47a81578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47a4000c00 tx=0x7f47a4004730 comp rx=0 tx=0).stop 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 shutdown_connections 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47a815be30 0x7f47a8157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47a815ba50 0x7f47a81578d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 --2- 172.21.15.152:0/1863036634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f47a80cff40 0x7f47a8154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 >> 172.21.15.152:0/1863036634 conn(0x7f47a80b3450 msgr2=0x7f47a815caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 shutdown_connections 2024-02-26T12:18:56.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.548+0000 7f47af955640 1 -- 172.21.15.152:0/1863036634 wait complete. 2024-02-26T12:18:56.544 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new a682819f-83df-46de-9f97-803d7f474dd7 5 2024-02-26T12:18:56.559 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.574+0000 7f5c84612040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-26T12:18:56.583 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.598+0000 7f17d3c2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-26T12:18:56.631 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:56.646+0000 7f17d3c2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-26T12:18:56.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.658+0000 7fdb1fc0f640 1 Processor -- start 2024-02-26T12:18:56.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.658+0000 7fdb1fc0f640 1 -- start start 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1fc0f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb1815a9d0 0x7fdb180b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1fc0f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 0x7fdb1815e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1fc0f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb180cbf20 con 0x7fdb1815adb0 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1fc0f640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb180cc200 con 0x7fdb180cba70 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1fc0f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb180cc4e0 con 0x7fdb1815a9d0 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb1815a9d0 0x7fdb180b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb1815a9d0 0x7fdb180b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54990/0 (socket says 172.21.15.152:54990) 2024-02-26T12:18:56.645 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 -- 172.21.15.152:0/1267437582 learned_addr learned my addr 172.21.15.152:0/1267437582 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1e1ac640 1 --2- 172.21.15.152:0/1267437582 >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 0x7fdb1815e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 -- 172.21.15.152:0/1267437582 >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 msgr2=0x7fdb1815e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 --2- 172.21.15.152:0/1267437582 >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 0x7fdb1815e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 -- 172.21.15.152:0/1267437582 >> v1:172.21.15.113:6789/0 conn(0x7fdb1815adb0 legacy=0x7fdb180cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1d9ab640 1 -- 172.21.15.152:0/1267437582 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180ce5c0 con 0x7fdb1815a9d0 2024-02-26T12:18:56.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.659+0000 7fdb1e1ac640 1 --2- 172.21.15.152:0/1267437582 >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 0x7fdb1815e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.660+0000 7fdb1d9ab640 1 --2- 172.21.15.152:0/1267437582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180b00e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdb18071fa0 tx=0x7fdb0802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b38ee8a80cfcb server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.660+0000 7fdb1c9a9640 1 -- 172.21.15.152:0/1267437582 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08034070 con 0x7fdb1815a9d0 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.660+0000 7fdb1c9a9640 1 -- 172.21.15.152:0/1267437582 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08030860 con 0x7fdb1815a9d0 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.660+0000 7fdb1c9a9640 1 -- 172.21.15.152:0/1267437582 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08030c30 con 0x7fdb1815a9d0 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/1267437582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 msgr2=0x7fdb180b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/1267437582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180b00e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdb18071fa0 tx=0x7fdb0802b9a0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/1267437582 shutdown_connections 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/1267437582 >> v2:172.21.15.113:3300/0 conn(0x7fdb180cba70 0x7fdb1815e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/1267437582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180b00e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/1267437582 >> 172.21.15.152:0/1267437582 conn(0x7fdb18099a40 msgr2=0x7fdb180d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/1267437582 shutdown_connections 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.661+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/1267437582 wait complete. 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.662+0000 7fdb1fc0f640 1 Processor -- start 2024-02-26T12:18:56.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.662+0000 7fdb1fc0f640 1 -- start start 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb180cba70 0x7fdb1814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1815ed80 con 0x7fdb180cba70 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1815ec00 con 0x7fdb1815a9d0 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1fc0f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1815ef00 con 0x7fdb1815adb0 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1e1ac640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55006/0 (socket says 172.21.15.152:55006) 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 -- 172.21.15.152:0/4194359028 learned_addr learned my addr 172.21.15.152:0/4194359028 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1e1ac640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53380/0 (socket says 172.21.15.152:53380) 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d9ab640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb180cba70 0x7fdb1814c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 -- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 msgr2=0x7fdb180ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 -- 172.21.15.152:0/4194359028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb180cba70 msgr2=0x7fdb1814c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb180cba70 0x7fdb1814c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 -- 172.21.15.152:0/4194359028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180ca750 con 0x7fdb1815a9d0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1e1ac640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.663+0000 7fdb1d1aa640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c3c0 tx=0x7fdb1400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140052d0 con 0x7fdb1815a9d0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14005490 con 0x7fdb1815a9d0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180b4250 con 0x7fdb1815a9d0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14007260 con 0x7fdb1815a9d0 2024-02-26T12:18:56.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb180b4810 con 0x7fdb1815a9d0 2024-02-26T12:18:56.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdb14007400 con 0x7fdb1815a9d0 2024-02-26T12:18:56.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.664+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdb14011590 con 0x7fdb1815a9d0 2024-02-26T12:18:56.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.665+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb18068180 con 0x7fdb1815a9d0 2024-02-26T12:18:56.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.667+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdb140035f0 con 0x7fdb1815a9d0 2024-02-26T12:18:56.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.748+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a682819f-83df-46de-9f97-803d7f474dd7", "id": 5} v 0) v1 -- 0x7fdb18074a50 con 0x7fdb1815a9d0 2024-02-26T12:18:56.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.752+0000 7fdb0e7fc640 1 -- 172.21.15.152:0/4194359028 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a682819f-83df-46de-9f97-803d7f474dd7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb14003a60 con 0x7fdb1815a9d0 2024-02-26T12:18:56.737 INFO:teuthology.orchestra.run.smithi152.stdout:5 2024-02-26T12:18:56.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 msgr2=0x7fdb180c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c3c0 tx=0x7fdb1400c7c0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 shutdown_connections 2024-02-26T12:18:56.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb1815adb0 0x7fdb180ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb1815a9d0 0x7fdb180c3ee0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 --2- 172.21.15.152:0/4194359028 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb180cba70 0x7fdb1814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 >> 172.21.15.152:0/4194359028 conn(0x7fdb18099a40 msgr2=0x7fdb181536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 shutdown_connections 2024-02-26T12:18:56.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.753+0000 7fdb1fc0f640 1 -- 172.21.15.152:0/4194359028 wait complete. 2024-02-26T12:18:56.748 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3 6 2024-02-26T12:18:56.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.902+0000 7fcac8774640 1 Processor -- start 2024-02-26T12:18:56.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 -- start start 2024-02-26T12:18:56.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcac006ab50 0x7fcac006afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac015bb80 con 0x7fcac015b7a0 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac0066a00 con 0x7fcac006ab50 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.903+0000 7fcac8774640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ce520 con 0x7fcac00ca590 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac5d0f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcac006ab50 0x7fcac006afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcac006ab50 0x7fcac006afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55010/0 (socket says 172.21.15.152:55010) 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac5d0f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53394/0 (socket says 172.21.15.152:53394) 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 -- 172.21.15.152:0/3308454013 learned_addr learned my addr 172.21.15.152:0/3308454013 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 -- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 msgr2=0x7fcac00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 -- 172.21.15.152:0/3308454013 >> v1:172.21.15.113:6789/0 conn(0x7fcac015b7a0 legacy=0x7fcac00cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac6d11640 1 -- 172.21.15.152:0/3308454013 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00ca9b0 con 0x7fcac006ab50 2024-02-26T12:18:56.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.904+0000 7fcac5d0f640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.905+0000 7fcac6d11640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac006afa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009e50 tx=0x7fcab802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8bac050569a8b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.905+0000 7fcac550e640 1 -- 172.21.15.152:0/3308454013 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab802ca70 con 0x7fcac006ab50 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.905+0000 7fcac550e640 1 -- 172.21.15.152:0/3308454013 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab802cc10 con 0x7fcac006ab50 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.905+0000 7fcac550e640 1 -- 172.21.15.152:0/3308454013 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80343f0 con 0x7fcac006ab50 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 -- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 msgr2=0x7fcac006afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac006afa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009e50 tx=0x7fcab802bed0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 -- 172.21.15.152:0/3308454013 shutdown_connections 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac006afa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 --2- 172.21.15.152:0/3308454013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac00ca590 0x7fcac00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 -- 172.21.15.152:0/3308454013 >> 172.21.15.152:0/3308454013 conn(0x7fcac00cc9c0 msgr2=0x7fcac00ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 -- 172.21.15.152:0/3308454013 shutdown_connections 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.906+0000 7fcac8774640 1 -- 172.21.15.152:0/3308454013 wait complete. 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.907+0000 7fcac8774640 1 Processor -- start 2024-02-26T12:18:56.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.907+0000 7fcac8774640 1 -- start start 2024-02-26T12:18:56.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcac00ca590 0x7fcac006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac0066f30 con 0x7fcac00ca590 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ce800 con 0x7fcac006ab50 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cc720 con 0x7fcac015b7a0 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6d11640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6d11640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53402/0 (socket says 172.21.15.152:53402) 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6d11640 1 -- 172.21.15.152:0/3087854631 learned_addr learned my addr 172.21.15.152:0/3087854631 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55018/0 (socket says 172.21.15.152:55018) 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac5d0f640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcac00ca590 0x7fcac006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 -- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 msgr2=0x7fcac006ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 -- 172.21.15.152:0/3087854631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcac00ca590 msgr2=0x7fcac006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcac00ca590 0x7fcac006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 -- 172.21.15.152:0/3087854631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0159e00 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6d11640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac6510640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c340 tx=0x7fcabc00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0052d0 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc005490 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac015a0e0 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.908+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc007260 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.909+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac015a980 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.909+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcabc007400 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.909+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcabc011b80 con 0x7fcac006ab50 2024-02-26T12:18:56.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.910+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0074a50 con 0x7fcac006ab50 2024-02-26T12:18:56.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.912+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcabc011dd0 con 0x7fcac006ab50 2024-02-26T12:18:56.940 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:56.954+0000 7f5c84612040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-26T12:18:56.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.984+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3", "id": 6} v 0) v1 -- 0x7fcac00cd890 con 0x7fcac006ab50 2024-02-26T12:18:56.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.987+0000 7fcab6ffd640 1 -- 172.21.15.152:0/3087854631 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcabc003aa0 con 0x7fcac006ab50 2024-02-26T12:18:56.972 INFO:teuthology.orchestra.run.smithi152.stdout:6 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 msgr2=0x7fcac01593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c340 tx=0x7fcabc00c800 comp rx=0 tx=0).stop 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 shutdown_connections 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcac015b7a0 0x7fcac006ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcac00ca590 0x7fcac006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 --2- 172.21.15.152:0/3087854631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcac006ab50 0x7fcac01593d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 >> 172.21.15.152:0/3087854631 conn(0x7fcac00cc9c0 msgr2=0x7fcac0161520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 shutdown_connections 2024-02-26T12:18:56.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:56.988+0000 7fcac8774640 1 -- 172.21.15.152:0/3087854631 wait complete. 2024-02-26T12:18:56.983 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 22317452-dd22-4bb2-8983-46a31d9f720d 7 2024-02-26T12:18:57.036 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.051+0000 7f17d3c2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-26T12:18:57.075 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.090+0000 7f5c84612040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.099+0000 7fd5cdbd8640 1 Processor -- start 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.099+0000 7fd5cdbd8640 1 -- start start 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 0x7fd5c80b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 0x7fd5c806f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c815d330 con 0x7fd5c815c700 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c806e1f0 con 0x7fd5c806fb90 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5cdbd8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815cae0 con 0x7fd5c806da50 2024-02-26T12:18:57.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 0x7fd5c806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55028/0 (socket says 172.21.15.152:55028) 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c7fff640 1 -- 172.21.15.152:0/4272414909 learned_addr learned my addr 172.21.15.152:0/4272414909 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c77fe640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 0x7fd5c80b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/4272414909 >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 msgr2=0x7fd5c815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/4272414909 >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 msgr2=0x7fd5c80b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 0x7fd5c80b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/4272414909 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c806df10 con 0x7fd5c806da50 2024-02-26T12:18:57.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c7fff640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.100+0000 7fd5c77fe640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 0x7fd5c80b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.101+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/4272414909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 0x7fd5c806f650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80ca4f0 tx=0x7fd5bc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598600a4f312011f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.101+0000 7fd5c67fc640 1 -- 172.21.15.152:0/4272414909 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0315a0 con 0x7fd5c806da50 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.101+0000 7fd5c67fc640 1 -- 172.21.15.152:0/4272414909 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc037070 con 0x7fd5c806da50 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.101+0000 7fd5c67fc640 1 -- 172.21.15.152:0/4272414909 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc031960 con 0x7fd5c806da50 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/4272414909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 msgr2=0x7fd5c806f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/4272414909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 0x7fd5c806f650 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80ca4f0 tx=0x7fd5bc02b840 comp rx=0 tx=0).stop 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/4272414909 shutdown_connections 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.152:3300/0 conn(0x7fd5c806fb90 0x7fd5c815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/4272414909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806da50 0x7fd5c806f650 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/4272414909 >> v2:172.21.15.113:3300/0 conn(0x7fd5c815c700 0x7fd5c80b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/4272414909 >> 172.21.15.152:0/4272414909 conn(0x7fd5c80cc9c0 msgr2=0x7fd5c80ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:57.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/4272414909 shutdown_connections 2024-02-26T12:18:57.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.102+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/4272414909 wait complete. 2024-02-26T12:18:57.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.103+0000 7fd5cdbd8640 1 Processor -- start 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.103+0000 7fd5cdbd8640 1 -- start start 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c806da50 0x7fd5c80b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5c815c700 0x7fd5c80a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8070020 con 0x7fd5c815c700 2024-02-26T12:18:57.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c815d050 con 0x7fd5c806da50 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b5e10 con 0x7fd5c806fb90 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c806da50 0x7fd5c80b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:53420/0 (socket says 172.21.15.152:53420) 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/3814195987 learned_addr learned my addr 172.21.15.152:0/3814195987 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c7fff640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5c815c700 0x7fd5c80a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c806da50 msgr2=0x7fd5c80b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c806da50 0x7fd5c80b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/3814195987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5c815c700 msgr2=0x7fd5c80a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5c815c700 0x7fd5c80a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 -- 172.21.15.152:0/3814195987 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80abf90 con 0x7fd5c806fb90 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5c6ffd640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009890 tx=0x7fd5bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:57.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc032630 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0327d0 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc032bc0 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.104+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c80ac790 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.105+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c80ce5c0 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.105+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd5bc006020 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.105+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd5bc02f030 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.105+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8074a50 con 0x7fd5c806fb90 2024-02-26T12:18:57.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.108+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd5bc040070 con 0x7fd5c806fb90 2024-02-26T12:18:57.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.178+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "22317452-dd22-4bb2-8983-46a31d9f720d", "id": 7} v 0) v1 -- 0x7fd5c80741c0 con 0x7fd5c806fb90 2024-02-26T12:18:57.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.183+0000 7fd5affff640 1 -- 172.21.15.152:0/3814195987 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22317452-dd22-4bb2-8983-46a31d9f720d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd5bc0064f0 con 0x7fd5c806fb90 2024-02-26T12:18:57.168 INFO:teuthology.orchestra.run.smithi152.stdout:7 2024-02-26T12:18:57.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 msgr2=0x7fd5c81f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009890 tx=0x7fd5bc0046c0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 shutdown_connections 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5c815c700 0x7fd5c80a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c806fb90 0x7fd5c81f33e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 --2- 172.21.15.152:0/3814195987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c806da50 0x7fd5c80b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 >> 172.21.15.152:0/3814195987 conn(0x7fd5c80cc9c0 msgr2=0x7fd5c806b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 shutdown_connections 2024-02-26T12:18:57.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-02-26T12:18:57.184+0000 7fd5cdbd8640 1 -- 172.21.15.152:0/3814195987 wait complete. 2024-02-26T12:18:57.175 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.190+0000 7f17d3c2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-26T12:18:57.180 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-26T12:18:57.180 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-26T12:18:57.182 INFO:tasks.ceph.osd.0:Started 2024-02-26T12:18:57.182 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-26T12:18:57.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-26T12:18:57.184 INFO:tasks.ceph.osd.1:Started 2024-02-26T12:18:57.184 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-26T12:18:57.184 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-26T12:18:57.186 INFO:tasks.ceph.osd.2:Started 2024-02-26T12:18:57.186 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-26T12:18:57.186 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-26T12:18:57.188 INFO:tasks.ceph.osd.3:Started 2024-02-26T12:18:57.188 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-26T12:18:57.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-26T12:18:57.190 INFO:tasks.ceph.osd.4:Started 2024-02-26T12:18:57.190 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-26T12:18:57.190 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-26T12:18:57.192 INFO:tasks.ceph.osd.5:Started 2024-02-26T12:18:57.192 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-26T12:18:57.193 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-26T12:18:57.194 INFO:tasks.ceph.osd.6:Started 2024-02-26T12:18:57.195 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-26T12:18:57.195 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-26T12:18:57.197 INFO:tasks.ceph.osd.7:Started 2024-02-26T12:18:57.197 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:18:57.204 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.219+0000 7f5c84612040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-26T12:18:57.276 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.291+0000 7f5c84612040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-26T12:18:57.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.331+0000 7f5d40e88640 1 Processor -- start 2024-02-26T12:18:57.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.331+0000 7f5d40e88640 1 -- start start 2024-02-26T12:18:57.318 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.331+0000 7f17d3c2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 0x7f5d3c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5d3c0b2d80 0x7f5d3c0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c0d1f50 con 0x7f5d3c0d3530 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c0d2230 con 0x7f5d3c0b2d80 2024-02-26T12:18:57.320 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d40e88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0d2510 con 0x7f5d3c15def0 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d3ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d3ad9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44758/0 (socket says 172.21.15.113:44758) 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/4100000400 learned_addr learned my addr 172.21.15.113:0/4100000400 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d39d9b640 1 --2- 172.21.15.113:0/4100000400 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c0b2d80 0x7f5d3c0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.332+0000 7f5d3a59c640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 0x7f5d3c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/4100000400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 msgr2=0x7f5d3c0b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 0x7f5d3c0b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/4100000400 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c0b2d80 msgr2=0x7f5d3c0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/4100000400 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c0b2d80 0x7f5d3c0d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/4100000400 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c0d27f0 con 0x7f5d3c0d3530 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3a59c640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 0x7f5d3c0b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0d4be0 tx=0x7f5d2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b65a93651164ff server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:57.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3959a640 1 -- 172.21.15.113:0/4100000400 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c035020 con 0x7f5d3c0d3530 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3959a640 1 -- 172.21.15.113:0/4100000400 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c031870 con 0x7f5d3c0d3530 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.333+0000 7f5d3959a640 1 -- 172.21.15.113:0/4100000400 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c031c40 con 0x7f5d3c0d3530 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 -- 172.21.15.113:0/4100000400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0d3530 msgr2=0x7f5d3c0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0d4be0 tx=0x7f5d2c02b910 comp rx=0 tx=0).stop 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 -- 172.21.15.113:0/4100000400 shutdown_connections 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0ce8b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 --2- 172.21.15.113:0/4100000400 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c0b2d80 0x7f5d3c0d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 --2- 172.21.15.113:0/4100000400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15def0 0x7f5d3c0b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 -- 172.21.15.113:0/4100000400 >> 172.21.15.113:0/4100000400 conn(0x7f5d3c0728b0 msgr2=0x7f5d3c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 -- 172.21.15.113:0/4100000400 shutdown_connections 2024-02-26T12:18:57.323 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.334+0000 7f5d40e88640 1 -- 172.21.15.113:0/4100000400 wait complete. 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.336+0000 7f5d40e88640 1 Processor -- start 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.336+0000 7f5d40e88640 1 -- start start 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 0x7f5d3c15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:57.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0b9ac0 con 0x7f5d3c0b8430 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0b9940 con 0x7f5d3c0d3530 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cedf0 con 0x7f5d3c0b2d80 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:41042/0 (socket says 172.21.15.113:41042) 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3a59c640 1 -- 172.21.15.113:0/1997388645 learned_addr learned my addr 172.21.15.113:0/1997388645 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d39d9b640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 0x7f5d3c15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 msgr2=0x7f5d3c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0d3530 msgr2=0x7f5d3c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 -- 172.21.15.113:0/1997388645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c160510 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3a59c640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d3ad9d640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 0x7f5d3c15fba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c033000 tx=0x7f5d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c03ad60 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0443f0 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c1607f0 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.337+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0447e0 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.338+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c0cbb40 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.338+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5d2c04b060 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.338+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5d2c044d10 con 0x7f5d3c0b8430 2024-02-26T12:18:57.327 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.338+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c074a50 con 0x7f5d3c0b8430 2024-02-26T12:18:57.328 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.340+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5d2c03f070 con 0x7f5d3c0b8430 2024-02-26T12:18:57.363 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.377+0000 7f17d3c2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-26T12:18:57.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.402+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d3c0b57d0 con 0x7f5d3c0b8430 2024-02-26T12:18:57.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.402+0000 7f5d2affd640 1 -- 172.21.15.113:0/1997388645 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f5d2c04d810 con 0x7f5d3c0b8430 2024-02-26T12:18:57.388 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:18:57.389 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":10,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:18:57.179821+0000","last_up_change":"0.000000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:18:57.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 msgr2=0x7f5d3c15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:57.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 0x7f5d3c15fba0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c033000 tx=0x7f5d2c0046c0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 shutdown_connections 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d3c0b8430 0x7f5d3c15fba0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0d3530 0x7f5d3c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 --2- 172.21.15.113:0/1997388645 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c0b2d80 0x7f5d3c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 >> 172.21.15.113:0/1997388645 conn(0x7f5d3c0728b0 msgr2=0x7f5d3c0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:57.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 shutdown_connections 2024-02-26T12:18:57.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:18:57.403+0000 7f5d40e88640 1 -- 172.21.15.113:0/1997388645 wait complete. 2024-02-26T12:18:57.397 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.412+0000 7f5c84612040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-26T12:18:57.399 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-26T12:18:57.400 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-26T12:18:57.472 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.487+0000 7f17d3c2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-26T12:18:57.494 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.509+0000 7f5c84612040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-26T12:18:57.568 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.582+0000 7f17d3c2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-26T12:18:57.650 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.665+0000 7f5c84612040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-26T12:18:57.693 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.708+0000 7f5c84612040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-26T12:18:57.721 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.735+0000 7f17d3c2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-26T12:18:57.762 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.777+0000 7f17d3c2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-26T12:18:57.794 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-02-26T12:18:57.809+0000 7f44960c6640 -1 Falling back to public interface 2024-02-26T12:18:57.802 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-26T12:18:57.816+0000 7ff12870d640 -1 Falling back to public interface 2024-02-26T12:18:57.805 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-26T12:18:57.820+0000 7fb5c3e0d640 -1 Falling back to public interface 2024-02-26T12:18:57.808 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-02-26T12:18:57.823+0000 7f8a03dfa640 -1 Falling back to public interface 2024-02-26T12:18:57.810 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-26T12:18:57.825+0000 7f9a16df8640 -1 Falling back to public interface 2024-02-26T12:18:57.811 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-02-26T12:18:57.825+0000 7f4f890f9640 -1 Falling back to public interface 2024-02-26T12:18:57.814 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-02-26T12:18:57.829+0000 7fb3dc223640 -1 Falling back to public interface 2024-02-26T12:18:57.815 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-26T12:18:57.829+0000 7f7d2cd71640 -1 Falling back to public interface 2024-02-26T12:18:57.853 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:57.867+0000 7f5c84612040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-26T12:18:57.922 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:57.937+0000 7f17d3c2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-26T12:18:58.206 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-26T12:18:58.297 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.311+0000 7f6b000de640 1 Processor -- start 2024-02-26T12:18:58.297 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.311+0000 7f6b000de640 1 -- start start 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6b000de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 0x7f6af80b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6b000de640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 0x7f6af806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6b000de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af80b5910 con 0x7f6af80afc20 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6b000de640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af806b530 con 0x7f6af806ab80 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6b000de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af8145890 con 0x7f6af81454b0 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6afd679640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6af80afc20 0x7f6af80b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:57784/0 (socket says 172.21.15.113:57784) 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6afde7a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 0x7f6af80b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6afd679640 1 -- 172.21.15.113:0/3349745007 learned_addr learned my addr 172.21.15.113:0/3349745007 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.312+0000 7f6afe67b640 1 --2- 172.21.15.113:0/3349745007 >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 0x7f6af806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:58.299 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afde7a640 1 -- 172.21.15.113:0/3349745007 >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 msgr2=0x7f6af806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afde7a640 1 --2- 172.21.15.113:0/3349745007 >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 0x7f6af806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afde7a640 1 -- 172.21.15.113:0/3349745007 >> v1:172.21.15.152:6789/0 conn(0x7f6af80afc20 legacy=0x7f6af80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afde7a640 1 -- 172.21.15.113:0/3349745007 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80b3770 con 0x7f6af81454b0 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afce78640 1 -- 172.21.15.113:0/3349745007 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940925283 0 0) 0x7f6af80b5910 con 0x7f6af80afc20 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afe67b640 1 --2- 172.21.15.113:0/3349745007 >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 0x7f6af806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.313+0000 7f6afde7a640 1 --2- 172.21.15.113:0/3349745007 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 0x7f6af80b5280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009d90 tx=0x7f6af002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f957c0b7fb21ca6 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6afce78640 1 -- 172.21.15.113:0/3349745007 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0039070 con 0x7f6af81454b0 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6afce78640 1 -- 172.21.15.113:0/3349745007 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af002cce0 con 0x7f6af81454b0 2024-02-26T12:18:58.300 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6afce78640 1 -- 172.21.15.113:0/3349745007 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0034660 con 0x7f6af81454b0 2024-02-26T12:18:58.303 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 -- 172.21.15.113:0/3349745007 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 msgr2=0x7f6af80b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:58.303 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 --2- 172.21.15.113:0/3349745007 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 0x7f6af80b5280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009d90 tx=0x7f6af002bf30 comp rx=0 tx=0).stop 2024-02-26T12:18:58.303 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 -- 172.21.15.113:0/3349745007 shutdown_connections 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 --2- 172.21.15.113:0/3349745007 >> v2:172.21.15.152:3300/0 conn(0x7f6af806ab80 0x7f6af806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 --2- 172.21.15.113:0/3349745007 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af81454b0 0x7f6af80b5280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 -- 172.21.15.113:0/3349745007 >> 172.21.15.113:0/3349745007 conn(0x7f6af80b5bf0 msgr2=0x7f6af80b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 -- 172.21.15.113:0/3349745007 shutdown_connections 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.314+0000 7f6b000de640 1 -- 172.21.15.113:0/3349745007 wait complete. 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.315+0000 7f6b000de640 1 Processor -- start 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.315+0000 7f6b000de640 1 -- start start 2024-02-26T12:18:58.304 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 0x7f6af8139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6af81454b0 0x7f6af815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80b3d30 con 0x7f6af80afc20 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80b40a0 con 0x7f6af81454b0 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6b000de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af80b0040 con 0x7f6af806ab80 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44780/0 (socket says 172.21.15.113:44780) 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 -- 172.21.15.113:0/2043027902 learned_addr learned my addr 172.21.15.113:0/2043027902 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afde7a640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 0x7f6af8139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afe67b640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6af81454b0 0x7f6af815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 -- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 msgr2=0x7f6af8139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:58.305 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 0x7f6af8139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 -- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6af81454b0 msgr2=0x7f6af815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.316+0000 7f6afd679640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6af81454b0 0x7f6af815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6afd679640 1 -- 172.21.15.113:0/2043027902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8139980 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6afde7a640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 0x7f6af8139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6afd679640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c4d0 tx=0x7f6ae800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80074e0 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80047e0 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af8139c60 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8004bd0 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af813a220 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6ae8011070 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.317+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6ae8004d70 con 0x7f6af80afc20 2024-02-26T12:18:58.306 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.318+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af8071df0 con 0x7f6af80afc20 2024-02-26T12:18:58.307 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.320+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6af8071df0 con 0x7f6af80afc20 2024-02-26T12:18:58.366 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.381+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6af80b4e30 con 0x7f6af80afc20 2024-02-26T12:18:58.367 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.381+0000 7f6aee7fc640 1 -- 172.21.15.113:0/2043027902 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f6af80b4e30 con 0x7f6af80afc20 2024-02-26T12:18:58.367 INFO:teuthology.misc.health.smithi113.stdout: 2024-02-26T12:18:58.367 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":10,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:18:57.179821+0000","last_up_change":"0.000000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:18:58.368 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 msgr2=0x7f6af809e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:18:58.368 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c4d0 tx=0x7f6ae800c8d0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.368 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 shutdown_connections 2024-02-26T12:18:58.368 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6af81454b0 0x7f6af815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.369 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6af80afc20 0x7f6af809e300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.369 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 --2- 172.21.15.113:0/2043027902 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6af806ab80 0x7f6af8139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:18:58.369 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 >> 172.21.15.113:0/2043027902 conn(0x7f6af80b5bf0 msgr2=0x7f6af80b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:18:58.369 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 shutdown_connections 2024-02-26T12:18:58.369 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:18:58.382+0000 7f6b000de640 1 -- 172.21.15.113:0/2043027902 wait complete. 2024-02-26T12:18:58.376 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-26T12:18:58.673 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:58.687+0000 7f5c84612040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-26T12:18:58.751 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:58.766+0000 7f17d3c2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-26T12:18:58.949 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:58.964+0000 7f5c84612040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-26T12:18:59.001 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:59.016+0000 7f5c84612040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-26T12:18:59.027 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:59.042+0000 7f17d3c2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-26T12:18:59.077 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:59.092+0000 7f17d3c2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-26T12:18:59.115 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:18:59.129+0000 7f5c84612040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-26T12:18:59.197 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-02-26T12:18:59.211+0000 7f17d3c2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-26T12:19:00.143 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:19:00.158+0000 7f5c24c7d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-26T12:19:00.143 INFO:tasks.ceph.mgr.y.smithi113.stderr:2024-02-26T12:19:00.158+0000 7f5c24c7d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-26T12:19:01.268 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-02-26T12:19:01.282+0000 7f4f890f9640 -1 osd.2 0 log_to_monitors true 2024-02-26T12:19:01.309 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-26T12:19:01.324+0000 7f9a16df8640 -1 osd.4 0 log_to_monitors true 2024-02-26T12:19:01.310 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-02-26T12:19:01.325+0000 7f8a03dfa640 -1 osd.1 0 log_to_monitors true 2024-02-26T12:19:01.312 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-26T12:19:01.327+0000 7ff12870d640 -1 osd.6 0 log_to_monitors true 2024-02-26T12:19:01.321 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-26T12:19:01.336+0000 7f7d2cd71640 -1 osd.5 0 log_to_monitors true 2024-02-26T12:19:01.322 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-26T12:19:01.337+0000 7fb5c3e0d640 -1 osd.7 0 log_to_monitors true 2024-02-26T12:19:01.356 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-02-26T12:19:01.371+0000 7f44960c6640 -1 osd.3 0 log_to_monitors true 2024-02-26T12:19:01.372 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-02-26T12:19:01.387+0000 7fb3dc223640 -1 osd.0 0 log_to_monitors true 2024-02-26T12:19:04.634 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-02-26T12:19:04.649+0000 7f89ff1f6640 -1 osd.1 0 waiting for initial osdmap 2024-02-26T12:19:04.647 INFO:tasks.ceph.osd.1.smithi113.stderr:2024-02-26T12:19:04.662+0000 7f89f7880640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:04.647 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-02-26T12:19:04.662+0000 7f44915f6640 -1 osd.3 0 waiting for initial osdmap 2024-02-26T12:19:04.652 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-02-26T12:19:04.667+0000 7f4f85df9640 -1 osd.2 0 waiting for initial osdmap 2024-02-26T12:19:04.658 INFO:tasks.ceph.osd.3.smithi113.stderr:2024-02-26T12:19:04.673+0000 7f4489c6f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:04.658 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-02-26T12:19:04.673+0000 7fb3d6ff6640 -1 osd.0 0 waiting for initial osdmap 2024-02-26T12:19:04.667 INFO:tasks.ceph.osd.2.smithi113.stderr:2024-02-26T12:19:04.682+0000 7f4f7cc80640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:04.674 INFO:tasks.ceph.osd.0.smithi113.stderr:2024-02-26T12:19:04.689+0000 7fb3cf680640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:05.162 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-26T12:19:05.176+0000 7fb5bebf6640 -1 osd.7 0 waiting for initial osdmap 2024-02-26T12:19:05.176 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-02-26T12:19:05.191+0000 7fb5b73d6640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:05.183 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:05.203 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-26T12:19:05.218+0000 7ff1253f9640 -1 osd.6 0 waiting for initial osdmap 2024-02-26T12:19:05.213 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-26T12:19:05.228+0000 7f7d281f6640 -1 osd.5 0 waiting for initial osdmap 2024-02-26T12:19:05.219 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-02-26T12:19:05.234+0000 7ff11c280640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:05.223 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-02-26T12:19:05.238+0000 7f7d20880640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:05.227 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-26T12:19:05.242+0000 7f9a121f6640 -1 osd.4 0 waiting for initial osdmap 2024-02-26T12:19:05.237 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-02-26T12:19:05.252+0000 7f9a0a880640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-26T12:19:05.274 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.288+0000 7f1263584640 1 Processor -- start 2024-02-26T12:19:05.274 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 -- start start 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f125c15dc20 0x7f125c0b9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f125c0ce800 0x7f125c0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c1626e0 con 0x7f125c0d3b90 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c162400 con 0x7f125c0ce800 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.289+0000 7f1263584640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0ce310 con 0x7f125c15dc20 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f125c0ce800 0x7f125c0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f125c0ce800 0x7f125c0cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33548/0 (socket says 172.21.15.113:33548) 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 -- 172.21.15.113:0/2772166897 learned_addr learned my addr 172.21.15.113:0/2772166897 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:05.276 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1261320640 1 --2- 172.21.15.113:0/2772166897 >> v2:172.21.15.152:3300/0 conn(0x7f125c15dc20 0x7f125c0b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 -- 172.21.15.113:0/2772166897 >> v2:172.21.15.152:3300/0 conn(0x7f125c15dc20 msgr2=0x7f125c0b9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 --2- 172.21.15.113:0/2772166897 >> v2:172.21.15.152:3300/0 conn(0x7f125c15dc20 0x7f125c0b9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 -- 172.21.15.113:0/2772166897 >> v1:172.21.15.152:6789/0 conn(0x7f125c0d3b90 legacy=0x7f125c0d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.290+0000 7f1260b1f640 1 -- 172.21.15.113:0/2772166897 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0cf1b0 con 0x7f125c0ce800 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1260b1f640 1 --2- 172.21.15.113:0/2772166897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c0ce800 0x7f125c0cec70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f125c0b5b80 tx=0x7f125002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3c550186f317df server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f124ffff640 1 -- 172.21.15.113:0/2772166897 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250034070 con 0x7f125c0ce800 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f124ffff640 1 -- 172.21.15.113:0/2772166897 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250030860 con 0x7f125c0ce800 2024-02-26T12:19:05.277 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f124ffff640 1 -- 172.21.15.113:0/2772166897 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250030c30 con 0x7f125c0ce800 2024-02-26T12:19:05.280 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 -- 172.21.15.113:0/2772166897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c0ce800 msgr2=0x7f125c0cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.280 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 --2- 172.21.15.113:0/2772166897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c0ce800 0x7f125c0cec70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f125c0b5b80 tx=0x7f125002b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 -- 172.21.15.113:0/2772166897 shutdown_connections 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 --2- 172.21.15.113:0/2772166897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c0ce800 0x7f125c0cec70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 --2- 172.21.15.113:0/2772166897 >> v2:172.21.15.152:3300/0 conn(0x7f125c15dc20 0x7f125c0b9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 -- 172.21.15.113:0/2772166897 >> 172.21.15.113:0/2772166897 conn(0x7f125c0726d0 msgr2=0x7f125c072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 -- 172.21.15.113:0/2772166897 shutdown_connections 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.291+0000 7f1263584640 1 -- 172.21.15.113:0/2772166897 wait complete. 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.292+0000 7f1263584640 1 Processor -- start 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 -- start start 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 0x7f125c0cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f125c0d3b90 0x7f125c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.281 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c161db0 con 0x7f125c15dc20 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c161ad0 con 0x7f125c0d3b90 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1263584640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c162090 con 0x7f125c0ce800 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1261b21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1261b21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:33550/0 (socket says 172.21.15.113:33550) 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.293+0000 7f1261b21640 1 -- 172.21.15.113:0/3929975122 learned_addr learned my addr 172.21.15.113:0/3929975122 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1260b1f640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f125c0d3b90 0x7f125c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261320640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 0x7f125c0cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 -- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 msgr2=0x7f125c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 0x7f125c0cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 -- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f125c0d3b90 msgr2=0x7f125c1f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f125c0d3b90 0x7f125c1f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 -- 172.21.15.113:0/3929975122 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0aa8a0 con 0x7f125c15dc20 2024-02-26T12:19:05.282 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261320640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 0x7f125c0cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1261b21640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f125400c7a0 tx=0x7f125400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254003b70 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254003d30 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125400aa90 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c0aab80 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.294+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c0cc9e0 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.295+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c0685d0 con 0x7f125c15dc20 2024-02-26T12:19:05.283 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.296+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f125400ac30 con 0x7f125c15dc20 2024-02-26T12:19:05.284 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.296+0000 7f124dffb640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 0x7f124006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:05.284 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.296+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1254089210 con 0x7f125c15dc20 2024-02-26T12:19:05.284 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.296+0000 7f1261320640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 0x7f124006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:05.284 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.296+0000 7f1261320640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 0x7f124006d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1258009a20 tx=0x7f1258008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:05.285 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.300+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1254058f90 con 0x7f125c15dc20 2024-02-26T12:19:05.457 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.472+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f125c0cce80 con 0x7f125c15dc20 2024-02-26T12:19:05.458 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.472+0000 7f124dffb640 1 -- 172.21.15.113:0/3929975122 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1254058890 con 0x7f125c15dc20 2024-02-26T12:19:05.458 INFO:teuthology.misc.health.smithi113.stdout: 2024-02-26T12:19:05.458 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":12,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:03.161611+0000","last_up_change":"0.000000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 msgr2=0x7f124006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 0x7f124006d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1258009a20 tx=0x7f1258008040 comp rx=0 tx=0).stop 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 msgr2=0x7f125c1f2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f125400c7a0 tx=0x7f125400cc60 comp rx=0 tx=0).stop 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 shutdown_connections 2024-02-26T12:19:05.460 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f124006b440 0x7f124006d900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f125c15dc20 0x7f125c1f2f30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f125c0d3b90 0x7f125c1f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 --2- 172.21.15.113:0/3929975122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f125c0ce800 0x7f125c0cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 >> 172.21.15.113:0/3929975122 conn(0x7f125c0726d0 msgr2=0x7f125c0b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 shutdown_connections 2024-02-26T12:19:05.461 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:05.474+0000 7f1263584640 1 -- 172.21.15.113:0/3929975122 wait complete. 2024-02-26T12:19:05.470 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-02-26T12:19:12.276 DEBUG:teuthology.orchestra.run.smithi113:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:12.377 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.391+0000 7fc1f911e640 1 Processor -- start 2024-02-26T12:19:12.377 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.391+0000 7fc1f911e640 1 -- start start 2024-02-26T12:19:12.380 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1f911e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc1f40cd940 0x7fc1f40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.380 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1f911e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40cdd20 con 0x7fc1f40d12f0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1f911e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40d0250 con 0x7fc1f409a2d0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1f911e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40d0530 con 0x7fc1f40cd940 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1ebfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc1f40d12f0 0x7fc1f4099bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54182/0 (socket says 172.21.15.113:54182) 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.392+0000 7fc1ebfff640 1 -- 172.21.15.113:0/1583999683 learned_addr learned my addr 172.21.15.113:0/1583999683 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/1583999683 >> v2:172.21.15.152:3300/0 conn(0x7fc1f40cd940 0x7fc1f40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496842495 0 0) 0x7fc1f40cdd20 con 0x7fc1f40d12f0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e0003520 con 0x7fc1f40d12f0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473514522 0 0) 0x7fc1f40d0250 con 0x7fc1f409a2d0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f40cdd20 con 0x7fc1f409a2d0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175193132 0 0) 0x7fc1e0003520 con 0x7fc1f40d12f0 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 >> v2:172.21.15.152:3300/0 conn(0x7fc1f40cd940 msgr2=0x7fc1f40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 --2- 172.21.15.113:0/1583999683 >> v2:172.21.15.152:3300/0 conn(0x7fc1f40cd940 0x7fc1f40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 >> v1:172.21.15.152:6789/0 conn(0x7fc1f409a2d0 legacy=0x7fc1f415d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.381 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40d0810 con 0x7fc1f40d12f0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fc1dc001670 con 0x7fc1f40d12f0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 >> v1:172.21.15.113:6789/0 conn(0x7fc1f40d12f0 legacy=0x7fc1f4099bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1e0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40d0530 con 0x7fc1e0003b40 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c040 con 0x7fc1e0004800 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c240 con 0x7fc1e00051c0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1e0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1ebfff640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f359e640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1e00051c0 msgr2=0x7fc1e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:12.382 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e0004800 msgr2=0x7fc1e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/1583999683 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0003520 con 0x7fc1e0003b40 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.393+0000 7fc1f359e640 1 -- 172.21.15.113:0/1583999683 reap_dead start 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.394+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1e0003f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009ac0 tx=0x7fc1e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d673882b9c170b89 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.394+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4039070 con 0x7fc1e0003b40 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.394+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e402c6b0 con 0x7fc1e0003b40 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.394+0000 7fc1f259c640 1 -- 172.21.15.113:0/1583999683 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4009690 con 0x7fc1e0003b40 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 -- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 msgr2=0x7fc1e0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1e0003f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009ac0 tx=0x7fc1e0005830 comp rx=0 tx=0).stop 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 -- 172.21.15.113:0/1583999683 shutdown_connections 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 --2- 172.21.15.113:0/1583999683 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1e0003f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.383 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 -- 172.21.15.113:0/1583999683 >> 172.21.15.113:0/1583999683 conn(0x7fc1f40b33d0 msgr2=0x7fc1f40b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:12.384 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 -- 172.21.15.113:0/1583999683 shutdown_connections 2024-02-26T12:19:12.384 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.395+0000 7fc1f911e640 1 -- 172.21.15.113:0/1583999683 wait complete. 2024-02-26T12:19:12.386 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.396+0000 7fc1f911e640 1 Processor -- start 2024-02-26T12:19:12.386 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.396+0000 7fc1f911e640 1 -- start start 2024-02-26T12:19:12.386 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.386 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1f41f3770 0x7fc1f415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f415d600 0x7fc1f40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f406cf60 con 0x7fc1e0003b40 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40d0dd0 con 0x7fc1f415d600 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f911e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41f3c50 con 0x7fc1f41f3770 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45174/0 (socket says 172.21.15.113:45174) 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/2687728226 learned_addr learned my addr 172.21.15.113:0/2687728226 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1f41f3770 msgr2=0x7fc1f415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1f41f3770 0x7fc1f415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f415d600 msgr2=0x7fc1f40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f415d600 0x7fc1f40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.397+0000 7fc1f2d9d640 1 -- 172.21.15.113:0/2687728226 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f41f3f30 con 0x7fc1e0003b40 2024-02-26T12:19:12.387 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1f2d9d640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4000c00 tx=0x7fc1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4042020 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e403a040 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f41f4210 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4039070 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.398+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40c7960 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.399+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f41f4730 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.399+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1e4045020 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.400+0000 7fc1eb7fe640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.400+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1e40ab2a0 con 0x7fc1e0003b40 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.400+0000 7fc1ebfff640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.388 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.400+0000 7fc1ebfff640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 0x7fc1d406d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc000ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.389 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.404+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1f41f4730 con 0x7fc1e0003b40 2024-02-26T12:19:12.565 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.580+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1f4074b30 con 0x7fc1e0003b40 2024-02-26T12:19:12.566 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.580+0000 7fc1eb7fe640 1 -- 172.21.15.113:0/2687728226 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12908 (secure 0 0 0) 0x7fc1f4074b30 con 0x7fc1e0003b40 2024-02-26T12:19:12.566 INFO:teuthology.misc.health.smithi113.stdout: 2024-02-26T12:19:12.566 INFO:teuthology.misc.health.smithi113.stdout:{"epoch":16,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:09.319106+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:12.568 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 msgr2=0x7fc1d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.568 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 0x7fc1d406d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc000ed0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 msgr2=0x7fc1f415c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4000c00 tx=0x7fc1e4004730 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 shutdown_connections 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc1d406b4d0 0x7fc1d406d990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1f415d600 0x7fc1f40c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1f41f3770 0x7fc1f415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 --2- 172.21.15.113:0/2687728226 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1e0003b40 0x7fc1f415c040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 >> 172.21.15.113:0/2687728226 conn(0x7fc1f40b33d0 msgr2=0x7fc1f406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 shutdown_connections 2024-02-26T12:19:12.569 INFO:teuthology.misc.health.smithi113.stderr:2024-02-26T12:19:12.583+0000 7fc1f911e640 1 -- 172.21.15.113:0/2687728226 wait complete. 2024-02-26T12:19:12.578 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-02-26T12:19:12.578 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-26T12:19:12.578 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-26T12:19:12.579 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-26T12:19:12.581 INFO:tasks.ceph.mds.a:Started 2024-02-26T12:19:12.581 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-26T12:19:12.581 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-26T12:19:12.583 INFO:tasks.ceph.mds.c:Started 2024-02-26T12:19:12.583 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-26T12:19:12.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-26T12:19:12.586 INFO:tasks.ceph.mds.b:Started 2024-02-26T12:19:12.586 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-26T12:19:12.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-26T12:19:12.589 INFO:tasks.ceph.mds.d:Started 2024-02-26T12:19:12.589 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-26T12:19:12.592 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:12.658 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2024-02-26T12:19:12.658 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2024-02-26T12:19:12.673 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2024-02-26T12:19:12.673 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2024-02-26T12:19:12.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.712+0000 7f4ad84de640 1 Processor -- start 2024-02-26T12:19:12.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.712+0000 7f4ad84de640 1 -- start start 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad84de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 0x7f4ad0166b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad84de640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad006b970 con 0x7f4ad00b0e80 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad84de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad015c810 con 0x7f4ad015c160 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad84de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00b1260 con 0x7f4ad00cdae0 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad627a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4ad00b0e80 0x7f4ad006ab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54216/0 (socket says 172.21.15.113:54216) 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad627a640 1 -- 172.21.15.113:0/1466748250 learned_addr learned my addr 172.21.15.113:0/1466748250 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad6a7b640 1 --2- 172.21.15.113:0/1466748250 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 0x7f4ad0166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305876137 0 0) 0x7f4ad006b970 con 0x7f4ad00b0e80 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4abc003520 con 0x7f4ad00b0e80 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54187812 0 0) 0x7f4ad015c810 con 0x7f4ad015c160 2024-02-26T12:19:12.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad006b970 con 0x7f4ad015c160 2024-02-26T12:19:12.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1466748250 >> v1:172.21.15.152:6789/0 conn(0x7f4ad015c160 legacy=0x7f4ad006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1466748250 >> v1:172.21.15.113:6789/0 conn(0x7f4ad00b0e80 legacy=0x7f4ad006ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.713+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1466748250 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad015caf0 con 0x7f4ad00cdae0 2024-02-26T12:19:12.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.714+0000 7f4ad6a7b640 1 --2- 172.21.15.113:0/1466748250 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 0x7f4ad0166b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009dc0 tx=0x7f4ac802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae26557074d003d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.714+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8039070 con 0x7f4ad00cdae0 2024-02-26T12:19:12.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.714+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac802ccd0 con 0x7f4ad00cdae0 2024-02-26T12:19:12.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.714+0000 7f4ad5278640 1 -- 172.21.15.113:0/1466748250 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8034640 con 0x7f4ad00cdae0 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 -- 172.21.15.113:0/1466748250 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 msgr2=0x7f4ad0166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1466748250 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 0x7f4ad0166b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009dc0 tx=0x7f4ac802bf20 comp rx=0 tx=0).stop 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 -- 172.21.15.113:0/1466748250 shutdown_connections 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1466748250 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00cdae0 0x7f4ad0166b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 -- 172.21.15.113:0/1466748250 >> 172.21.15.113:0/1466748250 conn(0x7f4ad00d0770 msgr2=0x7f4ad00d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 -- 172.21.15.113:0/1466748250 shutdown_connections 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.715+0000 7f4ad84de640 1 -- 172.21.15.113:0/1466748250 wait complete. 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.716+0000 7f4ad84de640 1 Processor -- start 2024-02-26T12:19:12.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.716+0000 7f4ad84de640 1 -- start start 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00b0e80 0x7f4ad014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ad00cdae0 0x7f4ad00c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad015d0b0 con 0x7f4ad015c160 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00cc640 con 0x7f4ad00cdae0 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c3f90 con 0x7f4ad00b0e80 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45196/0 (socket says 172.21.15.113:45196) 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1045006809 learned_addr learned my addr 172.21.15.113:0/1045006809 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad627a640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00b0e80 0x7f4ad014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad5a79640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ad00cdae0 0x7f4ad00c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00b0e80 msgr2=0x7f4ad014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00b0e80 0x7f4ad014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ad00cdae0 msgr2=0x7f4ad00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ad00cdae0 0x7f4ad00c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 -- 172.21.15.113:0/1045006809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad014f920 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad6a7b640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009dc0 tx=0x7f4ac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8039050 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8045070 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8009450 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad00c7460 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.717+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad00c92e0 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.718+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0068180 con 0x7f4ad015c160 2024-02-26T12:19:12.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.719+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ac803e830 con 0x7f4ad015c160 2024-02-26T12:19:12.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.719+0000 7f4ac6ffd640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 0x7f4ab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.719+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ac80acea0 con 0x7f4ad015c160 2024-02-26T12:19:12.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.719+0000 7f4ad627a640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 0x7f4ab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:12.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.720+0000 7f4ad627a640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 0x7f4ab406d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000f60 tx=0x7f4acc007d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:12.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.723+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ac807bc00 con 0x7f4ad015c160 2024-02-26T12:19:12.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.895+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad00725c0 con 0x7f4ad015c160 2024-02-26T12:19:12.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.896+0000 7f4ac6ffd640 1 -- 172.21.15.113:0/1045006809 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12908 (secure 0 0 0) 0x7f4ad00725c0 con 0x7f4ad015c160 2024-02-26T12:19:12.881 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:12.882 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:09.319106+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:12.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 msgr2=0x7f4ab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 0x7f4ab406d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4acc000f60 tx=0x7f4acc007d70 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 msgr2=0x7f4ad014f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009dc0 tx=0x7f4ac8004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 shutdown_connections 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ab406b4d0 0x7f4ab406d990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ad015c160 0x7f4ad014f3e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ad00cdae0 0x7f4ad00c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 --2- 172.21.15.113:0/1045006809 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ad00b0e80 0x7f4ad014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 >> 172.21.15.113:0/1045006809 conn(0x7f4ad00d0770 msgr2=0x7f4ad0151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 shutdown_connections 2024-02-26T12:19:12.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:12.898+0000 7f4ad84de640 1 -- 172.21.15.113:0/1045006809 wait complete. 2024-02-26T12:19:12.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:12.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:12.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.012+0000 7ff70575e640 1 Processor -- start 2024-02-26T12:19:12.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.012+0000 7ff70575e640 1 -- start start 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff70575e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000b5d20 0x7ff7000ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff70575e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7000ce930 0x7ff7000d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff70575e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000d1dc0 con 0x7ff70015de30 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff70575e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff700161d50 con 0x7ff7000ce930 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff70575e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000ceda0 con 0x7ff7000b5d20 2024-02-26T12:19:12.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7000ce930 0x7ff7000d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff7000ce930 0x7ff7000d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45210/0 (socket says 172.21.15.113:45210) 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 -- 172.21.15.113:0/3921401755 learned_addr learned my addr 172.21.15.113:0/3921401755 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6fe7fc640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000b5d20 0x7ff7000ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 -- 172.21.15.113:0/3921401755 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000b5d20 msgr2=0x7ff7000ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000b5d20 0x7ff7000ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 -- 172.21.15.113:0/3921401755 >> v1:172.21.15.152:6789/0 conn(0x7ff70015de30 legacy=0x7ff7000b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.013+0000 7ff6ff7fe640 1 -- 172.21.15.113:0/3921401755 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000cf000 con 0x7ff7000ce930 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff6ff7fe640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000ce930 0x7ff7000d2860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009e50 tx=0x7ff6f802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb0c01291640f49 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff6fdffb640 1 -- 172.21.15.113:0/3921401755 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f802ca70 con 0x7ff7000ce930 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff6fdffb640 1 -- 172.21.15.113:0/3921401755 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f802cc10 con 0x7ff7000ce930 2024-02-26T12:19:13.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff6fdffb640 1 -- 172.21.15.113:0/3921401755 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80343f0 con 0x7ff7000ce930 2024-02-26T12:19:13.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff70575e640 1 -- 172.21.15.113:0/3921401755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000ce930 msgr2=0x7ff7000d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.014+0000 7ff70575e640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000ce930 0x7ff7000d2860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009e50 tx=0x7ff6f802bed0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 -- 172.21.15.113:0/3921401755 shutdown_connections 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000ce930 0x7ff7000d2860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 --2- 172.21.15.113:0/3921401755 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000b5d20 0x7ff7000ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 -- 172.21.15.113:0/3921401755 >> 172.21.15.113:0/3921401755 conn(0x7ff7000d0610 msgr2=0x7ff7000d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 -- 172.21.15.113:0/3921401755 shutdown_connections 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.015+0000 7ff70575e640 1 -- 172.21.15.113:0/3921401755 wait complete. 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.016+0000 7ff70575e640 1 Processor -- start 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.016+0000 7ff70575e640 1 -- start start 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 0x7ff7000cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 0x7ff7000cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000b6dc0 con 0x7ff7000b5d20 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000d2340 con 0x7ff70015de30 2024-02-26T12:19:13.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015e210 con 0x7ff7000ce930 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45220/0 (socket says 172.21.15.113:45220) 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 -- 172.21.15.113:0/3168998431 learned_addr learned my addr 172.21.15.113:0/3168998431 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6ff7fe640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 0x7ff7000cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6fe7fc640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 0x7ff7000cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 -- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 msgr2=0x7ff7000cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 0x7ff7000cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 -- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 msgr2=0x7ff7000cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 0x7ff7000cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 -- 172.21.15.113:0/3168998431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000b91e0 con 0x7ff7000b5d20 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6ff7fe640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 0x7ff7000cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6fe7fc640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 0x7ff7000cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6feffd640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000b3f0 tx=0x7ff6f000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0015020 con 0x7ff7000b5d20 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0011830 con 0x7ff7000b5d20 2024-02-26T12:19:13.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7000cb7d0 con 0x7ff7000b5d20 2024-02-26T12:19:13.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0011c20 con 0x7ff7000b5d20 2024-02-26T12:19:13.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.017+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000cbd90 con 0x7ff7000b5d20 2024-02-26T12:19:13.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.018+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7000cfba0 con 0x7ff7000b5d20 2024-02-26T12:19:13.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.019+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff6f0018020 con 0x7ff7000b5d20 2024-02-26T12:19:13.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.019+0000 7ff6e77fe640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 0x7ff6ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.019+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6f0089aa0 con 0x7ff7000b5d20 2024-02-26T12:19:13.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.019+0000 7ff6fe7fc640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 0x7ff6ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.019+0000 7ff6fe7fc640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 0x7ff6ec06d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff7000b9530 tx=0x7ff6f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.023+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7000cfba0 con 0x7ff7000b5d20 2024-02-26T12:19:13.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.193+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff700074a50 con 0x7ff7000b5d20 2024-02-26T12:19:13.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.193+0000 7ff6e77fe640 1 -- 172.21.15.113:0/3168998431 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6f001f030 con 0x7ff7000b5d20 2024-02-26T12:19:13.178 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 msgr2=0x7ff6ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 0x7ff6ec06d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff7000b9530 tx=0x7ff6f4008040 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 msgr2=0x7ff7000c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000b3f0 tx=0x7ff6f000b8b0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 shutdown_connections 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff6ec06b4d0 0x7ff6ec06d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff70015de30 0x7ff7000cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7000ce930 0x7ff7000cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 --2- 172.21.15.113:0/3168998431 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff7000b5d20 0x7ff7000c98a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 >> 172.21.15.113:0/3168998431 conn(0x7ff7000d0610 msgr2=0x7ff70015c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 shutdown_connections 2024-02-26T12:19:13.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.195+0000 7ff70575e640 1 -- 172.21.15.113:0/3168998431 wait complete. 2024-02-26T12:19:13.191 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:13.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.305+0000 7f58a8a95640 1 Processor -- start 2024-02-26T12:19:13.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.305+0000 7f58a8a95640 1 -- start start 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a8a95640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58a40aed50 0x7f58a415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a8a95640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f58a415bf80 0x7f58a415c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a8a95640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a415eb60 con 0x7f58a406d250 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a8a95640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40af130 con 0x7f58a40aed50 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a8a95640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a415ee40 con 0x7f58a415bf80 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58a40aed50 0x7f58a415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58a40aed50 0x7f58a415e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45226/0 (socket says 172.21.15.113:45226) 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 -- 172.21.15.113:0/546197782 learned_addr learned my addr 172.21.15.113:0/546197782 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a2d9d640 1 --2- 172.21.15.113:0/546197782 >> v2:172.21.15.152:3300/0 conn(0x7f58a415bf80 0x7f58a415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 -- 172.21.15.113:0/546197782 >> v2:172.21.15.152:3300/0 conn(0x7f58a415bf80 msgr2=0x7f58a415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:13.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 --2- 172.21.15.113:0/546197782 >> v2:172.21.15.152:3300/0 conn(0x7f58a415bf80 0x7f58a415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 -- 172.21.15.113:0/546197782 >> v1:172.21.15.152:6789/0 conn(0x7f58a406d250 legacy=0x7f58a40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:13.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.306+0000 7f58a259c640 1 -- 172.21.15.113:0/546197782 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a415f120 con 0x7f58a40aed50 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.307+0000 7f58a259c640 1 --2- 172.21.15.113:0/546197782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a415e460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58a40cc3d0 tx=0x7f589402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271c0644a54f88b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.307+0000 7f58a159a640 1 -- 172.21.15.113:0/546197782 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589402ca80 con 0x7f58a40aed50 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.307+0000 7f58a159a640 1 -- 172.21.15.113:0/546197782 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589402cc20 con 0x7f58a40aed50 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.307+0000 7f58a159a640 1 -- 172.21.15.113:0/546197782 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58940343f0 con 0x7f58a40aed50 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 -- 172.21.15.113:0/546197782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 msgr2=0x7f58a415e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 --2- 172.21.15.113:0/546197782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a415e460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58a40cc3d0 tx=0x7f589402bee0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 -- 172.21.15.113:0/546197782 shutdown_connections 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 --2- 172.21.15.113:0/546197782 >> v2:172.21.15.152:3300/0 conn(0x7f58a415bf80 0x7f58a415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 --2- 172.21.15.113:0/546197782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a415e460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 -- 172.21.15.113:0/546197782 >> 172.21.15.113:0/546197782 conn(0x7f58a406ab50 msgr2=0x7f58a406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:13.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 -- 172.21.15.113:0/546197782 shutdown_connections 2024-02-26T12:19:13.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.308+0000 7f58a8a95640 1 -- 172.21.15.113:0/546197782 wait complete. 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.309+0000 7f58a8a95640 1 Processor -- start 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.309+0000 7f58a8a95640 1 -- start start 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f58a406d250 0x7f58a414c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58a415bf80 0x7f58a4148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40b4050 con 0x7f58a40aed50 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40b3420 con 0x7f58a415bf80 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a8a95640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40b41d0 con 0x7f58a406d250 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45232/0 (socket says 172.21.15.113:45232) 2024-02-26T12:19:13.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 -- 172.21.15.113:0/3305217596 learned_addr learned my addr 172.21.15.113:0/3305217596 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a2d9d640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58a415bf80 0x7f58a4148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 -- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f58a406d250 msgr2=0x7f58a414c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f58a406d250 0x7f58a414c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 -- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58a415bf80 msgr2=0x7f58a4148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58a415bf80 0x7f58a4148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 -- 172.21.15.113:0/3305217596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4147a30 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.310+0000 7f58a1d9b640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f589800c460 tx=0x7f589800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.311+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898016020 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.311+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898012870 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.311+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a4147d10 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.311+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898012c60 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.311+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a41482d0 con 0x7f58a40aed50 2024-02-26T12:19:13.298 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.312+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a4074a50 con 0x7f58a40aed50 2024-02-26T12:19:13.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.312+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5898019020 con 0x7f58a40aed50 2024-02-26T12:19:13.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.312+0000 7f5892ffd640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 0x7f588406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:13.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.312+0000 7f58a259c640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 0x7f588406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:13.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.313+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5898089bd0 con 0x7f58a40aed50 2024-02-26T12:19:13.299 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.313+0000 7f58a259c640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 0x7f588406d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5894035000 tx=0x7f589402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:13.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.317+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5898020030 con 0x7f58a40aed50 2024-02-26T12:19:13.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.523+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58a40cc760 con 0x7f58a40aed50 2024-02-26T12:19:13.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.524+0000 7f5892ffd640 1 -- 172.21.15.113:0/3305217596 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f5898058da0 con 0x7f58a40aed50 2024-02-26T12:19:13.509 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:13.509 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-26T12:19:13.510 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 2 2024-02-26T12:19:13.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 msgr2=0x7f588406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 0x7f588406d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5894035000 tx=0x7f589402e000 comp rx=0 tx=0).stop 2024-02-26T12:19:13.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 msgr2=0x7f58a4148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:13.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f589800c460 tx=0x7f589800c920 comp rx=0 tx=0).stop 2024-02-26T12:19:13.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 shutdown_connections 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f588406b4d0 0x7f588406d990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f58a415bf80 0x7f58a4148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58a40aed50 0x7f58a4148a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 --2- 172.21.15.113:0/3305217596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f58a406d250 0x7f58a414c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 >> 172.21.15.113:0/3305217596 conn(0x7f58a406ab50 msgr2=0x7f58a415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 shutdown_connections 2024-02-26T12:19:13.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:13.526+0000 7f58a8a95640 1 -- 172.21.15.113:0/3305217596 wait complete. 2024-02-26T12:19:15.523 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:15.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.650+0000 7f5532ed5640 1 Processor -- start 2024-02-26T12:19:15.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.650+0000 7f5532ed5640 1 -- start start 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5532ed5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f552c15def0 0x7f552c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5532ed5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0b2d80 0x7f552c0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5532ed5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552c0d1f50 con 0x7f552c0d3530 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5532ed5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552c0d2230 con 0x7f552c15def0 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5532ed5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0d2510 con 0x7f552c0b2d80 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f552c15def0 0x7f552c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f552c15def0 0x7f552c0b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45244/0 (socket says 172.21.15.113:45244) 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 -- 172.21.15.113:0/1223857081 learned_addr learned my addr 172.21.15.113:0/1223857081 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f552bfff640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0b2d80 0x7f552c0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 -- 172.21.15.113:0/1223857081 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0b2d80 msgr2=0x7f552c0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0b2d80 0x7f552c0d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 -- 172.21.15.113:0/1223857081 >> v1:172.21.15.152:6789/0 conn(0x7f552c0d3530 legacy=0x7f552c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.651+0000 7f5530c71640 1 -- 172.21.15.113:0/1223857081 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0d27f0 con 0x7f552c15def0 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f5530c71640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15def0 0x7f552c0b9400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5520009870 tx=0x7f552002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a427192f75566db server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f552b7fe640 1 -- 172.21.15.113:0/1223857081 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520034070 con 0x7f552c15def0 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f552b7fe640 1 -- 172.21.15.113:0/1223857081 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520030840 con 0x7f552c15def0 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f552b7fe640 1 -- 172.21.15.113:0/1223857081 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520030c10 con 0x7f552c15def0 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f5532ed5640 1 -- 172.21.15.113:0/1223857081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15def0 msgr2=0x7f552c0b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.652+0000 7f5532ed5640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15def0 0x7f552c0b9400 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5520009870 tx=0x7f552002b980 comp rx=0 tx=0).stop 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 -- 172.21.15.113:0/1223857081 shutdown_connections 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0b2d80 0x7f552c0d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 --2- 172.21.15.113:0/1223857081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15def0 0x7f552c0b9400 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 -- 172.21.15.113:0/1223857081 >> 172.21.15.113:0/1223857081 conn(0x7f552c0728b0 msgr2=0x7f552c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:15.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 -- 172.21.15.113:0/1223857081 shutdown_connections 2024-02-26T12:19:15.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.653+0000 7f5532ed5640 1 -- 172.21.15.113:0/1223857081 wait complete. 2024-02-26T12:19:15.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.654+0000 7f5532ed5640 1 Processor -- start 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.654+0000 7f5532ed5640 1 -- start start 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0b2d80 0x7f552c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0d3530 0x7f552c0aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0b9ac0 con 0x7f552c15ad30 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0b9940 con 0x7f552c0b2d80 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552c0cefc0 con 0x7f552c0d3530 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45250/0 (socket says 172.21.15.113:45250) 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 -- 172.21.15.113:0/926002195 learned_addr learned my addr 172.21.15.113:0/926002195 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5530c71640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0b2d80 0x7f552c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f552bfff640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0d3530 0x7f552c0aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 -- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0d3530 msgr2=0x7f552c0aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0d3530 0x7f552c0aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 -- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0b2d80 msgr2=0x7f552c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0b2d80 0x7f552c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 -- 172.21.15.113:0/926002195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0ab510 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5531472640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f552400c760 tx=0x7f552400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524016020 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524006d50 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c0ab7f0 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524003bb0 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.655+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c0cb380 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.657+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c074a50 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.657+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f55240050d0 con 0x7f552c15ad30 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.657+0000 7f55297fa640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 0x7f551006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.657+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5524089880 con 0x7f552c15ad30 2024-02-26T12:19:15.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.657+0000 7f5530c71640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 0x7f551006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.658+0000 7f5530c71640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 0x7f551006d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5520036000 tx=0x7f5520008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.661+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5524020020 con 0x7f552c15ad30 2024-02-26T12:19:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.867+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f552c0b47b0 con 0x7f552c15ad30 2024-02-26T12:19:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.867+0000 7f55297fa640 1 -- 172.21.15.113:0/926002195 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f5524058490 con 0x7f552c15ad30 2024-02-26T12:19:15.853 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:15.853 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4306,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-26T12:19:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 3 2024-02-26T12:19:15.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 msgr2=0x7f551006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 0x7f551006d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5520036000 tx=0x7f5520008030 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 msgr2=0x7f552c0ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f552400c760 tx=0x7f552400cb60 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 shutdown_connections 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f551006b4d0 0x7f551006d990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f552c15ad30 0x7f552c0ac8a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f552c0d3530 0x7f552c0aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 --2- 172.21.15.113:0/926002195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0b2d80 0x7f552c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 >> 172.21.15.113:0/926002195 conn(0x7f552c0728b0 msgr2=0x7f552c0d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 shutdown_connections 2024-02-26T12:19:15.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.869+0000 7f5532ed5640 1 -- 172.21.15.113:0/926002195 wait complete. 2024-02-26T12:19:15.865 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:15.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.980+0000 7fc7b4d1e640 1 Processor -- start 2024-02-26T12:19:15.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.980+0000 7fc7b4d1e640 1 -- start start 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7b4d1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7b4d1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b00b1720 0x7fc7b00cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7b4d1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b00b6670 con 0x7fc7b006ab50 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7b4d1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b01618c0 con 0x7fc7b00b1720 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7b4d1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00cadb0 con 0x7fc7b00b35b0 2024-02-26T12:19:15.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b00b1720 0x7fc7b00cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc7b00b1720 0x7fc7b00cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45258/0 (socket says 172.21.15.113:45258) 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 -- 172.21.15.113:0/2939472446 learned_addr learned my addr 172.21.15.113:0/2939472446 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7a7fff640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 -- 172.21.15.113:0/2939472446 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 msgr2=0x7fc7b00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 -- 172.21.15.113:0/2939472446 >> v1:172.21.15.152:6789/0 conn(0x7fc7b006ab50 legacy=0x7fc7b006af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.981+0000 7fc7aed9d640 1 -- 172.21.15.113:0/2939472446 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00b1c20 con 0x7fc7b00b1720 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7aed9d640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b00b1720 0x7fc7b00cd030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009e80 tx=0x7fc7a802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27203ed0cf7adab server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7add9b640 1 -- 172.21.15.113:0/2939472446 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a802ca50 con 0x7fc7b00b1720 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7add9b640 1 -- 172.21.15.113:0/2939472446 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a802cbf0 con 0x7fc7b00b1720 2024-02-26T12:19:15.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7add9b640 1 -- 172.21.15.113:0/2939472446 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a80343f0 con 0x7fc7b00b1720 2024-02-26T12:19:15.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/2939472446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b00b1720 msgr2=0x7fc7b00cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b00b1720 0x7fc7b00cd030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009e80 tx=0x7fc7a802beb0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/2939472446 shutdown_connections 2024-02-26T12:19:15.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b00b1720 0x7fc7b00cd030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.982+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/2939472446 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.983+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/2939472446 >> 172.21.15.113:0/2939472446 conn(0x7fc7b00d0760 msgr2=0x7fc7b00d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.983+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/2939472446 shutdown_connections 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.983+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/2939472446 wait complete. 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.984+0000 7fc7b4d1e640 1 Processor -- start 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.984+0000 7fc7b4d1e640 1 -- start start 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 0x7fc7b00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00cb2e0 con 0x7fc7b006ab50 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00cb000 con 0x7fc7b00b1720 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00ce680 con 0x7fc7b00b35b0 2024-02-26T12:19:15.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45272/0 (socket says 172.21.15.113:45272) 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 -- 172.21.15.113:0/712092410 learned_addr learned my addr 172.21.15.113:0/712092410 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7a7fff640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 0x7fc7b00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7aed9d640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 -- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 msgr2=0x7fc7b00c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 -- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 msgr2=0x7fc7b00c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 0x7fc7b00c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 -- 172.21.15.113:0/712092410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b00c7960 con 0x7fc7b006ab50 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7a7fff640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 0x7fc7b00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7ae59c640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c3c0 tx=0x7fc7a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00052d0 con 0x7fc7b006ab50 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a0005490 con 0x7fc7b006ab50 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b00c7c40 con 0x7fc7b006ab50 2024-02-26T12:19:15.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0007260 con 0x7fc7b006ab50 2024-02-26T12:19:15.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.985+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b00c8200 con 0x7fc7b006ab50 2024-02-26T12:19:15.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.986+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b00676f0 con 0x7fc7b006ab50 2024-02-26T12:19:15.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.987+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7a0007400 con 0x7fc7b006ab50 2024-02-26T12:19:15.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.987+0000 7fc7a6ffd640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 0x7fc79006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:15.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.987+0000 7fc7a7fff640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 0x7fc79006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:15.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.987+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7a0089270 con 0x7fc7b006ab50 2024-02-26T12:19:15.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.988+0000 7fc7a7fff640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 0x7fc79006d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc798006fd0 tx=0x7fc798008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:15.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:15.992+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7b00676f0 con 0x7fc7b006ab50 2024-02-26T12:19:16.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.162+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b0074a50 con 0x7fc7b006ab50 2024-02-26T12:19:16.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.163+0000 7fc7a6ffd640 1 -- 172.21.15.113:0/712092410 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12908 (secure 0 0 0) 0x7fc7a00584d0 con 0x7fc7b006ab50 2024-02-26T12:19:16.149 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:16.149 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":16,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:09.319106+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 msgr2=0x7fc79006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 0x7fc79006d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc798006fd0 tx=0x7fc798008040 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 msgr2=0x7fc7b0156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c3c0 tx=0x7fc7a000c880 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 shutdown_connections 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc79006b500 0x7fc79006d9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7b00b35b0 0x7fc7b00c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7b00b1720 0x7fc7b00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 --2- 172.21.15.113:0/712092410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7b006ab50 0x7fc7b0156b10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 >> 172.21.15.113:0/712092410 conn(0x7fc7b00d0760 msgr2=0x7fc7b00d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 shutdown_connections 2024-02-26T12:19:16.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.165+0000 7fc7b4d1e640 1 -- 172.21.15.113:0/712092410 wait complete. 2024-02-26T12:19:16.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:16.162 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:16.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.280+0000 7fdece4b7640 1 Processor -- start 2024-02-26T12:19:16.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.280+0000 7fdece4b7640 1 -- start start 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdece4b7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdece4b7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 0x7fdec80b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdece4b7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec80b9aa0 con 0x7fdec80d0ab0 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdece4b7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec80b7d60 con 0x7fdec80b27d0 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdece4b7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80b8040 con 0x7fdec815de80 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 0x7fdec80b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:48354/0 (socket says 172.21.15.113:48354) 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 -- 172.21.15.113:0/3030267125 learned_addr learned my addr 172.21.15.113:0/3030267125 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 -- 172.21.15.113:0/3030267125 >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 msgr2=0x7fdec80b93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 --2- 172.21.15.113:0/3030267125 >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 0x7fdec80b93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 -- 172.21.15.113:0/3030267125 >> v1:172.21.15.152:6789/0 conn(0x7fdec80d0ab0 legacy=0x7fdec80d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec7fff640 1 -- 172.21.15.113:0/3030267125 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80b8320 con 0x7fdec815de80 2024-02-26T12:19:16.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.281+0000 7fdec77fe640 1 --2- 172.21.15.113:0/3030267125 >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 0x7fdec80b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.282+0000 7fdec7fff640 1 --2- 172.21.15.113:0/3030267125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d13d3e88d2bdbd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.282+0000 7fdec6ffd640 1 -- 172.21.15.113:0/3030267125 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8035020 con 0x7fdec815de80 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.282+0000 7fdec6ffd640 1 -- 172.21.15.113:0/3030267125 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8031640 con 0x7fdec815de80 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.282+0000 7fdec6ffd640 1 -- 172.21.15.113:0/3030267125 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb802d040 con 0x7fdec815de80 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 -- 172.21.15.113:0/3030267125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 msgr2=0x7fdec80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 --2- 172.21.15.113:0/3030267125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009870 tx=0x7fdeb802b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 -- 172.21.15.113:0/3030267125 shutdown_connections 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 --2- 172.21.15.113:0/3030267125 >> v2:172.21.15.152:3300/0 conn(0x7fdec80b27d0 0x7fdec80b93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 --2- 172.21.15.113:0/3030267125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec815de80 0x7fdec80b8b20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 -- 172.21.15.113:0/3030267125 >> 172.21.15.113:0/3030267125 conn(0x7fdec80726a0 msgr2=0x7fdec8072ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 -- 172.21.15.113:0/3030267125 shutdown_connections 2024-02-26T12:19:16.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.283+0000 7fdece4b7640 1 -- 172.21.15.113:0/3030267125 wait complete. 2024-02-26T12:19:16.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.284+0000 7fdece4b7640 1 Processor -- start 2024-02-26T12:19:16.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.284+0000 7fdece4b7640 1 -- start start 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec80b27d0 0x7fdec815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 0x7fdec80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80d1080 con 0x7fdec815de80 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80d0f00 con 0x7fdec80d0ab0 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdece4b7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec80d1200 con 0x7fdec80b27d0 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45280/0 (socket says 172.21.15.113:45280) 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 -- 172.21.15.113:0/1029705723 learned_addr learned my addr 172.21.15.113:0/1029705723 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdec7fff640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec80b27d0 0x7fdec815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdec77fe640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 0x7fdec80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 -- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec80b27d0 msgr2=0x7fdec815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec80b27d0 0x7fdec815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 -- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 msgr2=0x7fdec80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 0x7fdec80ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdecca54640 1 -- 172.21.15.113:0/1029705723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80cc1b0 con 0x7fdec815de80 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.285+0000 7fdec77fe640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 0x7fdec80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdecca54640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c7a0 tx=0x7fdec000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0003b70 con 0x7fdec815de80 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec0003d30 con 0x7fdec815de80 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec000aa90 con 0x7fdec815de80 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec80cc490 con 0x7fdec815de80 2024-02-26T12:19:16.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.286+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec80cca50 con 0x7fdec815de80 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.287+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec8074a30 con 0x7fdec815de80 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.287+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdec000ac30 con 0x7fdec815de80 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.288+0000 7fdec4ff9640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 0x7fdeb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.288+0000 7fdec7fff640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 0x7fdeb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.288+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdec0089e70 con 0x7fdec815de80 2024-02-26T12:19:16.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.288+0000 7fdec7fff640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 0x7fdeb406d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8036000 tx=0x7fdeb803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.292+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdec0058fb0 con 0x7fdec815de80 2024-02-26T12:19:16.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.463+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdec80cf300 con 0x7fdec815de80 2024-02-26T12:19:16.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.463+0000 7fdec4ff9640 1 -- 172.21.15.113:0/1029705723 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdec00588b0 con 0x7fdec815de80 2024-02-26T12:19:16.449 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 msgr2=0x7fdeb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 0x7fdeb406d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8036000 tx=0x7fdeb803c040 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 msgr2=0x7fdec80cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdec000c7a0 tx=0x7fdec000cc60 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 shutdown_connections 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdeb406b500 0x7fdeb406d9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdec815de80 0x7fdec80cd250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdec80d0ab0 0x7fdec80ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 --2- 172.21.15.113:0/1029705723 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdec80b27d0 0x7fdec815b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.465+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 >> 172.21.15.113:0/1029705723 conn(0x7fdec80726a0 msgr2=0x7fdec815bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.466+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 shutdown_connections 2024-02-26T12:19:16.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.466+0000 7fdece4b7640 1 -- 172.21.15.113:0/1029705723 wait complete. 2024-02-26T12:19:16.462 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-26T12:19:16.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.577+0000 7f25f4999640 1 Processor -- start 2024-02-26T12:19:16.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.577+0000 7f25f4999640 1 -- start start 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25f4999640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25f00711f0 0x7f25f00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25f4999640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f00cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25f4999640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f00cf670 con 0x7f25f0071b10 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25f4999640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f0145840 con 0x7f25f00711f0 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25f4999640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f00cf950 con 0x7f25f006eb70 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25ee59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f25f00711f0 0x7f25f00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25e7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f25f0071b10 0x7f25f00ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54222/0 (socket says 172.21.15.113:54222) 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25e7fff640 1 -- 172.21.15.113:0/1720232536 learned_addr learned my addr 172.21.15.113:0/1720232536 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:16.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25ee59c640 1 -- 172.21.15.113:0/1720232536 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 msgr2=0x7f25f00cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:16.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25eed9d640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f00cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25ee59c640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f00cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25edd9b640 1 -- 172.21.15.113:0/1720232536 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149752772 0 0) 0x7f25f00cf670 con 0x7f25f0071b10 2024-02-26T12:19:16.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25ee59c640 1 -- 172.21.15.113:0/1720232536 >> v1:172.21.15.113:6789/0 conn(0x7f25f0071b10 legacy=0x7f25f00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.578+0000 7f25ee59c640 1 -- 172.21.15.113:0/1720232536 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00cfc30 con 0x7f25f00711f0 2024-02-26T12:19:16.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.579+0000 7f25ee59c640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f00715d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25e00097a0 tx=0x7f25e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f10bd1dabd3d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.579+0000 7f25edd9b640 1 -- 172.21.15.113:0/1720232536 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0035020 con 0x7f25f00711f0 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.579+0000 7f25edd9b640 1 -- 172.21.15.113:0/1720232536 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0031830 con 0x7f25f00711f0 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.579+0000 7f25edd9b640 1 -- 172.21.15.113:0/1720232536 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0031c00 con 0x7f25f00711f0 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 -- 172.21.15.113:0/1720232536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 msgr2=0x7f25f00715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f00715d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25e00097a0 tx=0x7f25e002b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 -- 172.21.15.113:0/1720232536 shutdown_connections 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f00cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 --2- 172.21.15.113:0/1720232536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f00715d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 -- 172.21.15.113:0/1720232536 >> 172.21.15.113:0/1720232536 conn(0x7f25f006ab50 msgr2=0x7f25f006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 -- 172.21.15.113:0/1720232536 shutdown_connections 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.580+0000 7f25f4999640 1 -- 172.21.15.113:0/1720232536 wait complete. 2024-02-26T12:19:16.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.581+0000 7f25f4999640 1 Processor -- start 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.581+0000 7f25f4999640 1 -- start start 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25f0071b10 0x7f25f0140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0165680 con 0x7f25f00711f0 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0071fc0 con 0x7f25f0071b10 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0165800 con 0x7f25f006eb70 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45304/0 (socket says 172.21.15.113:45304) 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 -- 172.21.15.113:0/602539383 learned_addr learned my addr 172.21.15.113:0/602539383 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25eed9d640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25f0071b10 0x7f25f0140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25ee59c640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 -- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 msgr2=0x7f25f013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f013e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 -- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25f0071b10 msgr2=0x7f25f0140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25f0071b10 0x7f25f0140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 -- 172.21.15.113:0/602539383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0141080 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e7fff640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c400 tx=0x7f25d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8017070 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8005ce0 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8007310 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.582+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f0141360 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.583+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f0141920 con 0x7f25f00711f0 2024-02-26T12:19:16.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.583+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f0141e10 con 0x7f25f00711f0 2024-02-26T12:19:16.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.584+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25d801a070 con 0x7f25f00711f0 2024-02-26T12:19:16.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.584+0000 7f25e6ffd640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 0x7f25d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.584+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25d8089320 con 0x7f25f00711f0 2024-02-26T12:19:16.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.584+0000 7f25ee59c640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 0x7f25d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.585+0000 7f25ee59c640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 0x7f25d006d9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25e0036000 tx=0x7f25e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.589+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25d8058470 con 0x7f25f00711f0 2024-02-26T12:19:16.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.760+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f25f0074a50 con 0x7f25f00711f0 2024-02-26T12:19:16.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.761+0000 7f25e6ffd640 1 -- 172.21.15.113:0/602539383 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f25d8057d70 con 0x7f25f00711f0 2024-02-26T12:19:16.746 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:16.746 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2024-02-26T12:19:16.747 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:19:16.747 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2024-02-26T12:19:16.747 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2024-02-26T12:19:16.747 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:19:16.747 INFO:teuthology.orchestra.run.smithi113.stdout:] 2024-02-26T12:19:16.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 msgr2=0x7f25d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 0x7f25d006d9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25e0036000 tx=0x7f25e0008030 comp rx=0 tx=0).stop 2024-02-26T12:19:16.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 msgr2=0x7f25f01402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f25d800c400 tx=0x7f25d800c8c0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 shutdown_connections 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f25d006b500 0x7f25d006d9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25f0071b10 0x7f25f0140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f25f00711f0 0x7f25f01402e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 --2- 172.21.15.113:0/602539383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f25f006eb70 0x7f25f013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 >> 172.21.15.113:0/602539383 conn(0x7f25f006ab50 msgr2=0x7f25f00af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 shutdown_connections 2024-02-26T12:19:16.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.763+0000 7f25f4999640 1 -- 172.21.15.113:0/602539383 wait complete. 2024-02-26T12:19:16.759 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-26T12:19:16.759 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-26T12:19:16.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.880+0000 7f9c03860640 1 Processor -- start 2024-02-26T12:19:16.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.880+0000 7f9c03860640 1 -- start start 2024-02-26T12:19:16.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c03860640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9bfc15df80 0x7f9bfc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c03860640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c03860640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0cccb0 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c03860640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bfc0cae40 con 0x7f9bfc15df80 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c03860640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0cb090 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c00dfb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9bfc0cd8e0 0x7f9bfc0cfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54234/0 (socket says 172.21.15.113:54234) 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c00dfb640 1 -- 172.21.15.113:0/2751220957 learned_addr learned my addr 172.21.15.113:0/2751220957 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c015fc640 1 --2- 172.21.15.113:0/2751220957 >> v2:172.21.15.152:3300/0 conn(0x7f9bfc15df80 0x7f9bfc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.867 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c01dfd640 1 --2- 172.21.15.113:0/2751220957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54159335 0 0) 0x7f9bfc0cccb0 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be8003520 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782708323 0 0) 0x7f9be8003520 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c01dfd640 1 -- 172.21.15.113:0/2751220957 >> v2:172.21.15.152:3300/0 conn(0x7f9bfc15df80 msgr2=0x7f9bfc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c01dfd640 1 --2- 172.21.15.113:0/2751220957 >> v2:172.21.15.152:3300/0 conn(0x7f9bfc15df80 0x7f9bfc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c01dfd640 1 -- 172.21.15.113:0/2751220957 >> v1:172.21.15.113:6789/0 conn(0x7f9bfc0cd8e0 legacy=0x7f9bfc0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.881+0000 7f9c01dfd640 1 -- 172.21.15.113:0/2751220957 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0cb370 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.882+0000 7f9c01dfd640 1 --2- 172.21.15.113:0/2751220957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc0c78c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf402bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85aaf34d1decce5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.882+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4039070 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.882+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf402c810 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.882+0000 7f9bf3fff640 1 -- 172.21.15.113:0/2751220957 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec001670 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 -- 172.21.15.113:0/2751220957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 msgr2=0x7f9bfc0c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 --2- 172.21.15.113:0/2751220957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc0c78c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009d90 tx=0x7f9bf402bce0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 -- 172.21.15.113:0/2751220957 shutdown_connections 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 --2- 172.21.15.113:0/2751220957 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc0c78c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 --2- 172.21.15.113:0/2751220957 >> v2:172.21.15.152:3300/0 conn(0x7f9bfc15df80 0x7f9bfc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 -- 172.21.15.113:0/2751220957 >> 172.21.15.113:0/2751220957 conn(0x7f9bfc099a40 msgr2=0x7f9bfc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 -- 172.21.15.113:0/2751220957 shutdown_connections 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.883+0000 7f9c03860640 1 -- 172.21.15.113:0/2751220957 wait complete. 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.884+0000 7f9c03860640 1 Processor -- start 2024-02-26T12:19:16.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.884+0000 7f9c03860640 1 -- start start 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc15f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 0x7f9bfc15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0cbc10 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0cb930 con 0x7f9bfc15df80 2024-02-26T12:19:16.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c03860640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0d0190 con 0x7f9bfc0cdd90 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45318/0 (socket says 172.21.15.113:45318) 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 -- 172.21.15.113:0/236396565 learned_addr learned my addr 172.21.15.113:0/236396565 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c00dfb640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c01dfd640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 0x7f9bfc15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 -- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 msgr2=0x7f9bfc15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc15f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 -- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 msgr2=0x7f9bfc15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 0x7f9bfc15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 -- 172.21.15.113:0/236396565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc15e360 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c01dfd640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 0x7f9bfc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9c015fc640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e8a0 tx=0x7f9bf800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.885+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8017070 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.886+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf800c940 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.886+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc15ffc0 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.886+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800cd30 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.886+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc15e900 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.887+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc074a50 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.887+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bf801a070 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.888+0000 7f9bf1ffb640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 0x7f9be006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.888+0000 7f9c00dfb640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 0x7f9be006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.888+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9bf8089c70 con 0x7f9bfc0cd8e0 2024-02-26T12:19:16.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.888+0000 7f9c00dfb640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 0x7f9be006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0013c0 tx=0x7f9bec001350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:16.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:16.892+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9bf8058880 con 0x7f9bfc0cd8e0 2024-02-26T12:19:17.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.063+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9bfc15be50 con 0x7f9bfc0cd8e0 2024-02-26T12:19:17.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.437+0000 7f9bf1ffb640 1 -- 172.21.15.113:0/236396565 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9bf805c920 con 0x7f9bfc0cd8e0 2024-02-26T12:19:17.422 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2024-02-26T12:19:17.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.439+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 msgr2=0x7f9be006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.439+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 0x7f9be006d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0013c0 tx=0x7f9bec001350 comp rx=0 tx=0).stop 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 msgr2=0x7f9bfc0c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e8a0 tx=0x7f9bf800ed60 comp rx=0 tx=0).stop 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 shutdown_connections 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9be006b4d0 0x7f9be006d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc15df80 0x7f9bfc15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0cdd90 0x7f9bfc15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 --2- 172.21.15.113:0/236396565 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9bfc0cd8e0 0x7f9bfc0c4fc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 >> 172.21.15.113:0/236396565 conn(0x7f9bfc099a40 msgr2=0x7f9bfc0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:17.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 shutdown_connections 2024-02-26T12:19:17.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.440+0000 7f9c03860640 1 -- 172.21.15.113:0/236396565 wait complete. 2024-02-26T12:19:17.439 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-26T12:19:17.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.561+0000 7fe276c36640 1 Processor -- start 2024-02-26T12:19:17.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.561+0000 7fe276c36640 1 -- start start 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe276c36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2700d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe276c36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2700b7270 0x7fe2700b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe276c36640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700b6db0 con 0x7fe2700d04e0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe276c36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700d2bc0 con 0x7fe2700b7270 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe276c36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d0e00 con 0x7fe2700d2780 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe2749d2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe2700d04e0 0x7fe2700cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54250/0 (socket says 172.21.15.113:54250) 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe2749d2640 1 -- 172.21.15.113:0/8377444 learned_addr learned my addr 172.21.15.113:0/8377444 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe2751d3640 1 --2- 172.21.15.113:0/8377444 >> v2:172.21.15.152:3300/0 conn(0x7fe2700b7270 0x7fe2700b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272643310 0 0) 0x7fe264001110 con 0x7fe2700d04e0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2700d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe260003520 con 0x7fe2700d04e0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1015209440 0 0) 0x7fe260003520 con 0x7fe2700d04e0 2024-02-26T12:19:17.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 msgr2=0x7fe2700d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2700d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 >> v2:172.21.15.152:3300/0 conn(0x7fe2700b7270 msgr2=0x7fe2700b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 --2- 172.21.15.113:0/8377444 >> v2:172.21.15.152:3300/0 conn(0x7fe2700b7270 0x7fe2700b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700d2e10 con 0x7fe2700d04e0 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe264001840 con 0x7fe2700d04e0 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2700d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 >> v1:172.21.15.113:6789/0 conn(0x7fe2700d04e0 legacy=0x7fe2700cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003ef0 0x7fe260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260004d40 0x7fe2600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d2bc0 con 0x7fe260003ef0 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d0e00 con 0x7fe260004d40 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.562+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26000ba70 con 0x7fe2700d2780 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003ef0 0x7fe260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe2749d2640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe2751d3640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260004d40 0x7fe2600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 -- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 msgr2=0x7fe2600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700d2780 0x7fe2600039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 -- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260004d40 msgr2=0x7fe2600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260004d40 0x7fe2600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 -- 172.21.15.113:0/8377444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260003520 con 0x7fe260003ef0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.563+0000 7fe26ffff640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003ef0 0x7fe260004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0098a0 tx=0x7fe260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33be49efd4d7e7c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x7fe260003ef0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c034d30 con 0x7fe260003ef0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe26f7fe640 1 -- 172.21.15.113:0/8377444 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c004250 con 0x7fe260003ef0 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 -- 172.21.15.113:0/8377444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003ef0 msgr2=0x7fe260004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 --2- 172.21.15.113:0/8377444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe260003ef0 0x7fe260004800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0098a0 tx=0x7fe260005830 comp rx=0 tx=0).stop 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe2751d3640 1 -- 172.21.15.113:0/8377444 reap_dead start 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 -- 172.21.15.113:0/8377444 shutdown_connections 2024-02-26T12:19:17.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 -- 172.21.15.113:0/8377444 >> 172.21.15.113:0/8377444 conn(0x7fe2700728b0 msgr2=0x7fe2700b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:17.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 -- 172.21.15.113:0/8377444 shutdown_connections 2024-02-26T12:19:17.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.564+0000 7fe276c36640 1 -- 172.21.15.113:0/8377444 wait complete. 2024-02-26T12:19:17.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.565+0000 7fe276c36640 1 Processor -- start 2024-02-26T12:19:17.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.565+0000 7fe276c36640 1 -- start start 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260003ef0 0x7fe270145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700c9540 0x7fe2700b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d36b0 con 0x7fe2700c6730 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700d33d0 con 0x7fe260003ef0 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe276c36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27015e050 con 0x7fe2700c9540 2024-02-26T12:19:17.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe2751d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe2751d3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:45336/0 (socket says 172.21.15.113:45336) 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe2751d3640 1 -- 172.21.15.113:0/3686665981 learned_addr learned my addr 172.21.15.113:0/3686665981 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe2749d2640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260003ef0 0x7fe270145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.566+0000 7fe26ffff640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700c9540 0x7fe2700b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 -- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700c9540 msgr2=0x7fe2700b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700c9540 0x7fe2700b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 -- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260003ef0 msgr2=0x7fe270145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260003ef0 0x7fe270145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 -- 172.21.15.113:0/3686665981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2700c70f0 con 0x7fe2700c6730 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe2751d3640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe27008cc60 tx=0x7fe26800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800fde0 con 0x7fe2700c6730 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26801d070 con 0x7fe2700c6730 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2700c9ca0 con 0x7fe2700c6730 2024-02-26T12:19:17.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268015670 con 0x7fe2700c6730 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.567+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270158820 con 0x7fe2700c6730 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.568+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe270074a50 con 0x7fe2700c6730 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.568+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe268015810 con 0x7fe2700c6730 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.569+0000 7fe26d7fa640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 0x7fe25406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.569+0000 7fe2749d2640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 0x7fe25406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.569+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe26808a950 con 0x7fe2700c6730 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.569+0000 7fe2749d2640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 0x7fe25406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe264001050 tx=0x7fe264009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:17.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.573+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe268010040 con 0x7fe2700c6730 2024-02-26T12:19:17.730 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:17.745+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe2700ca0f0 con 0x7fe2700c6730 2024-02-26T12:19:18.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.443+0000 7fe26d7fa640 1 -- 172.21.15.113:0/3686665981 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe2680599b0 con 0x7fe2700c6730 2024-02-26T12:19:18.428 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2024-02-26T12:19:18.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.446+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 msgr2=0x7fe25406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.446+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 0x7fe25406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe264001050 tx=0x7fe264009040 comp rx=0 tx=0).stop 2024-02-26T12:19:18.431 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.446+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 msgr2=0x7fe2700c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.446+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe27008cc60 tx=0x7fe26800f580 comp rx=0 tx=0).stop 2024-02-26T12:19:18.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 shutdown_connections 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe25406b500 0x7fe25406d9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe2700c6730 0x7fe2700c6bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2700c9540 0x7fe2700b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 --2- 172.21.15.113:0/3686665981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe260003ef0 0x7fe270145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.447+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 >> 172.21.15.113:0/3686665981 conn(0x7fe2700728b0 msgr2=0x7fe2700d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:18.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.448+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 shutdown_connections 2024-02-26T12:19:18.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.448+0000 7fe276c36640 1 -- 172.21.15.113:0/3686665981 wait complete. 2024-02-26T12:19:18.457 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-26T12:19:18.477 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:19:18.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:19:18.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.581+0000 7f74bd9bb640 1 Processor -- start 2024-02-26T12:19:18.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.581+0000 7f74bd9bb640 1 -- start start 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74bd9bb640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f74b815d8d0 0x7f74b80aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74bd9bb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74b806c270 0x7f74b806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74bd9bb640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b80adb50 con 0x7f74b80b37b0 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74bd9bb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80af3d0 con 0x7f74b806c270 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74bd9bb640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80addf0 con 0x7f74b815d8d0 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74b77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74b806c270 0x7f74b806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74b77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74b806c270 0x7f74b806dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38016/0 (socket says 172.21.15.113:38016) 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.582+0000 7f74b77fe640 1 -- 172.21.15.113:0/4033040827 learned_addr learned my addr 172.21.15.113:0/4033040827 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b6ffd640 1 --2- 172.21.15.113:0/4033040827 >> v2:172.21.15.152:3300/0 conn(0x7f74b815d8d0 0x7f74b80aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b77fe640 1 -- 172.21.15.113:0/4033040827 >> v2:172.21.15.152:3300/0 conn(0x7f74b815d8d0 msgr2=0x7f74b80aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:18.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b77fe640 1 --2- 172.21.15.113:0/4033040827 >> v2:172.21.15.152:3300/0 conn(0x7f74b815d8d0 0x7f74b80aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b77fe640 1 -- 172.21.15.113:0/4033040827 >> v1:172.21.15.152:6789/0 conn(0x7f74b80b37b0 legacy=0x7f74b806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b77fe640 1 -- 172.21.15.113:0/4033040827 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80ae0d0 con 0x7f74b806c270 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.583+0000 7f74b77fe640 1 --2- 172.21.15.113:0/4033040827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b806dbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74b8072a80 tx=0x7f74b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4f987d080b1105 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74b5ffb640 1 -- 172.21.15.113:0/4033040827 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0034070 con 0x7f74b806c270 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74b5ffb640 1 -- 172.21.15.113:0/4033040827 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b0030860 con 0x7f74b806c270 2024-02-26T12:19:18.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74b5ffb640 1 -- 172.21.15.113:0/4033040827 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0030c30 con 0x7f74b806c270 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 -- 172.21.15.113:0/4033040827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 msgr2=0x7f74b806dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/4033040827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b806dbf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f74b8072a80 tx=0x7f74b002b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 -- 172.21.15.113:0/4033040827 shutdown_connections 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/4033040827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b806dbf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/4033040827 >> v2:172.21.15.152:3300/0 conn(0x7f74b815d8d0 0x7f74b80aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 -- 172.21.15.113:0/4033040827 >> 172.21.15.113:0/4033040827 conn(0x7f74b8071b90 msgr2=0x7f74b8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:18.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 -- 172.21.15.113:0/4033040827 shutdown_connections 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.584+0000 7f74bd9bb640 1 -- 172.21.15.113:0/4033040827 wait complete. 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.585+0000 7f74bd9bb640 1 Processor -- start 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.585+0000 7f74bd9bb640 1 -- start start 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74b80b37b0 0x7f74b8145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74b815d8d0 0x7f74b8148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80ae970 con 0x7f74b806c270 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80ae690 con 0x7f74b80b37b0 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74bd9bb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80cc4b0 con 0x7f74b815d8d0 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38030/0 (socket says 172.21.15.113:38030) 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 -- 172.21.15.113:0/953041221 learned_addr learned my addr 172.21.15.113:0/953041221 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:18.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b67fc640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74b80b37b0 0x7f74b8145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b77fe640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74b815d8d0 0x7f74b8148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 -- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74b815d8d0 msgr2=0x7f74b8148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74b815d8d0 0x7f74b8148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 -- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74b80b37b0 msgr2=0x7f74b8145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.586+0000 7f74b6ffd640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74b80b37b0 0x7f74b8145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f74b6ffd640 1 -- 172.21.15.113:0/953041221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8145ec0 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f74b6ffd640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d10 tx=0x7f74a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8018020 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8014480 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b81461a0 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8014830 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.587+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8146760 con 0x7f74b806c270 2024-02-26T12:19:18.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.588+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b80ad3e0 con 0x7f74b806c270 2024-02-26T12:19:18.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.588+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74a8005d10 con 0x7f74b806c270 2024-02-26T12:19:18.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.589+0000 7f749ffff640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 0x7f74a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:18.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.589+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f74a808ade0 con 0x7f74b806c270 2024-02-26T12:19:18.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.589+0000 7f74b67fc640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 0x7f74a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:18.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.589+0000 7f74b67fc640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 0x7f74a406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ce540 tx=0x7f74ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:18.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.593+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74b80ad3e0 con 0x7f74b806c270 2024-02-26T12:19:18.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:18.804+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f74b8074a50 con 0x7f74b806c270 2024-02-26T12:19:19.445 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 2 and data pool 3 2024-02-26T12:19:19.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.459+0000 7f749ffff640 1 -- 172.21.15.113:0/953041221 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f74a8022030 con 0x7f74b806c270 2024-02-26T12:19:19.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.464+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 msgr2=0x7f74a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.464+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 0x7f74a406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ce540 tx=0x7f74ac009040 comp rx=0 tx=0).stop 2024-02-26T12:19:19.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.464+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 msgr2=0x7f74b80cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.464+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d10 tx=0x7f74a800c490 comp rx=0 tx=0).stop 2024-02-26T12:19:19.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 shutdown_connections 2024-02-26T12:19:19.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f74a406b4d0 0x7f74a406d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74b815d8d0 0x7f74b8148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74b80b37b0 0x7f74b8145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 --2- 172.21.15.113:0/953041221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74b806c270 0x7f74b80cf430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 >> 172.21.15.113:0/953041221 conn(0x7f74b8071b90 msgr2=0x7f74b806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:19.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 shutdown_connections 2024-02-26T12:19:19.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.465+0000 7f74bd9bb640 1 -- 172.21.15.113:0/953041221 wait complete. 2024-02-26T12:19:19.470 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:19.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.628+0000 7fc79911e640 1 Processor -- start 2024-02-26T12:19:19.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc79911e640 1 -- start start 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc79911e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7940d1290 0x7fc794160170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc79911e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79415c030 con 0x7fc79406b260 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc79911e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7940cf970 con 0x7fc79415bc50 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc79911e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7940cfc50 con 0x7fc7940d1290 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc78bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc79406b260 0x7fc7940cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57920/0 (socket says 172.21.15.113:57920) 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.629+0000 7fc78bfff640 1 -- 172.21.15.113:0/2276905085 learned_addr learned my addr 172.21.15.113:0/2276905085 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 --2- 172.21.15.113:0/2276905085 >> v2:172.21.15.152:3300/0 conn(0x7fc7940d1290 0x7fc794160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247585472 0 0) 0x7fc77c001110 con 0x7fc79406b260 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc780003520 con 0x7fc79406b260 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2675542727 0 0) 0x7fc780003520 con 0x7fc79406b260 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 >> v2:172.21.15.152:3300/0 conn(0x7fc7940d1290 msgr2=0x7fc794160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 --2- 172.21.15.113:0/2276905085 >> v2:172.21.15.152:3300/0 conn(0x7fc7940d1290 0x7fc794160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 >> v1:172.21.15.152:6789/0 conn(0x7fc79415bc50 legacy=0x7fc79406ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940cff30 con 0x7fc79406b260 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fc77c001840 con 0x7fc79406b260 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 >> v1:172.21.15.113:6789/0 conn(0x7fc79406b260 legacy=0x7fc7940cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800039b0 0x7fc780003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc780004800 0x7fc780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7940cfc50 con 0x7fc7800051c0 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78000c060 con 0x7fc780004800 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78000c260 con 0x7fc7800039b0 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc78bfff640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc780004800 0x7fc780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc792d9d640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800039b0 0x7fc780003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.619 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 -- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800039b0 msgr2=0x7fc780003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800039b0 0x7fc780003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 -- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc780004800 msgr2=0x7fc780004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc780004800 0x7fc780004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc79359e640 1 -- 172.21.15.113:0/2276905085 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780003520 con 0x7fc7800051c0 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.630+0000 7fc792d9d640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800039b0 0x7fc780003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.631+0000 7fc79359e640 1 -- 172.21.15.113:0/2276905085 reap_dead start 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.631+0000 7fc79359e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009fc0 tx=0x7fc780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e537ce0dd098c63 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.631+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c009c10 con 0x7fc7800051c0 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.631+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c02cca0 con 0x7fc7800051c0 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.631+0000 7fc79259c640 1 -- 172.21.15.113:0/2276905085 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c003bd0 con 0x7fc7800051c0 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 -- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 msgr2=0x7fc78000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009fc0 tx=0x7fc780005830 comp rx=0 tx=0).stop 2024-02-26T12:19:19.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 -- 172.21.15.113:0/2276905085 shutdown_connections 2024-02-26T12:19:19.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 --2- 172.21.15.113:0/2276905085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7800051c0 0x7fc78000b9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 -- 172.21.15.113:0/2276905085 >> 172.21.15.113:0/2276905085 conn(0x7fc7940d0770 msgr2=0x7fc7940d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:19.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 -- 172.21.15.113:0/2276905085 shutdown_connections 2024-02-26T12:19:19.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.632+0000 7fc79911e640 1 -- 172.21.15.113:0/2276905085 wait complete. 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.633+0000 7fc79911e640 1 Processor -- start 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.633+0000 7fc79911e640 1 -- start start 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 0x7fc7940b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 0x7fc794156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79406b920 con 0x7fc7940c65c0 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79406b7a0 con 0x7fc7940c6140 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc794160170 con 0x7fc7800051c0 2024-02-26T12:19:19.624 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38060/0 (socket says 172.21.15.113:38060) 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 -- 172.21.15.113:0/3919807452 learned_addr learned my addr 172.21.15.113:0/3919807452 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc792d9d640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 0x7fc7940b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc78bfff640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 0x7fc794156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 -- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 msgr2=0x7fc7940b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 0x7fc7940b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 -- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 msgr2=0x7fc794156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 0x7fc794156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 -- 172.21.15.113:0/3919807452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940c3ed0 con 0x7fc7940c65c0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc792d9d640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 0x7fc7940b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc78bfff640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 0x7fc794156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79359e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00e200 tx=0x7fc78c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c042020 con 0x7fc7940c65c0 2024-02-26T12:19:19.625 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c02ce50 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940c4170 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.634+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c003dc0 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.635+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7940c4730 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.635+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc794074a50 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.636+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc78c045020 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.636+0000 7fc78b7fe640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 0x7fc77406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.636+0000 7fc792d9d640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 0x7fc77406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.636+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc78c0acc00 con 0x7fc7940c65c0 2024-02-26T12:19:19.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.637+0000 7fc792d9d640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 0x7fc77406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.627 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.640+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc78c0b3080 con 0x7fc7940c65c0 2024-02-26T12:19:19.800 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.815+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7940b66f0 con 0x7fc7940c65c0 2024-02-26T12:19:19.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.816+0000 7fc78b7fe640 1 -- 172.21.15.113:0/3919807452 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fc78c04c020 con 0x7fc7940c65c0 2024-02-26T12:19:19.801 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:19.801 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":19,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:18.805795+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 msgr2=0x7fc77406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 0x7fc77406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784009040 comp rx=0 tx=0).stop 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 msgr2=0x7fc794156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00e200 tx=0x7fc78c009750 comp rx=0 tx=0).stop 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 shutdown_connections 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc77406b4d0 0x7fc77406d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc7940c65c0 0x7fc794156d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7940c6140 0x7fc794156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 --2- 172.21.15.113:0/3919807452 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7800051c0 0x7fc7940b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 >> 172.21.15.113:0/3919807452 conn(0x7fc7940d0770 msgr2=0x7fc7940b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:19.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 shutdown_connections 2024-02-26T12:19:19.804 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.818+0000 7fc79911e640 1 -- 172.21.15.113:0/3919807452 wait complete. 2024-02-26T12:19:19.814 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:19.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.929+0000 7fc7263fa640 1 Processor -- start 2024-02-26T12:19:19.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.929+0000 7fc7263fa640 1 -- start start 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc7263fa640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc72015db00 0x7fc7200cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc7263fa640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc72015dee0 0x7fc7200b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc7263fa640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7200711d0 con 0x7fc720070c60 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc7263fa640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7200714b0 con 0x7fc72015dee0 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc7263fa640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc720071790 con 0x7fc72015db00 2024-02-26T12:19:19.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc72015dee0 0x7fc7200b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc72015dee0 0x7fc7200b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38074/0 (socket says 172.21.15.113:38074) 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 -- 172.21.15.113:0/1226415519 learned_addr learned my addr 172.21.15.113:0/1226415519 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 -- 172.21.15.113:0/1226415519 >> v2:172.21.15.152:3300/0 conn(0x7fc72015db00 msgr2=0x7fc7200cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1226415519 >> v2:172.21.15.152:3300/0 conn(0x7fc72015db00 0x7fc7200cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 -- 172.21.15.113:0/1226415519 >> v1:172.21.15.152:6789/0 conn(0x7fc720070c60 legacy=0x7fc720161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.930+0000 7fc71f7fe640 1 -- 172.21.15.113:0/1226415519 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720071a70 con 0x7fc72015dee0 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1226415519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc72015dee0 0x7fc7200b3350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7200c8950 tx=0x7fc71402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616cbf3b4f4c243b server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc71effd640 1 -- 172.21.15.113:0/1226415519 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714035020 con 0x7fc72015dee0 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc71effd640 1 -- 172.21.15.113:0/1226415519 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc714031870 con 0x7fc72015dee0 2024-02-26T12:19:19.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc71effd640 1 -- 172.21.15.113:0/1226415519 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714031c40 con 0x7fc72015dee0 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 -- 172.21.15.113:0/1226415519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc72015dee0 msgr2=0x7fc7200b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1226415519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc72015dee0 0x7fc7200b3350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7200c8950 tx=0x7fc71402b910 comp rx=0 tx=0).stop 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 -- 172.21.15.113:0/1226415519 shutdown_connections 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1226415519 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc72015dee0 0x7fc7200b3350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1226415519 >> v2:172.21.15.152:3300/0 conn(0x7fc72015db00 0x7fc7200cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.931+0000 7fc7263fa640 1 -- 172.21.15.113:0/1226415519 >> 172.21.15.113:0/1226415519 conn(0x7fc7200ce350 msgr2=0x7fc7200ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:19.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.932+0000 7fc7263fa640 1 -- 172.21.15.113:0/1226415519 shutdown_connections 2024-02-26T12:19:19.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.932+0000 7fc7263fa640 1 -- 172.21.15.113:0/1226415519 wait complete. 2024-02-26T12:19:19.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 Processor -- start 2024-02-26T12:19:19.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 -- start start 2024-02-26T12:19:19.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 0x7fc7200b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 0x7fc72014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72006c150 con 0x7fc720070c60 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7200d03f0 con 0x7fc72015db00 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.933+0000 7fc7263fa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72006c2d0 con 0x7fc72015dee0 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38082/0 (socket says 172.21.15.113:38082) 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 -- 172.21.15.113:0/1957446942 learned_addr learned my addr 172.21.15.113:0/1957446942 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 0x7fc7200b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc724997640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 0x7fc72014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 -- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 msgr2=0x7fc72014bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 0x7fc72014bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 -- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 msgr2=0x7fc7200b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 0x7fc7200b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:19.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 -- 172.21.15.113:0/1957446942 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200b1c90 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 0x7fc7200b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc724997640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 0x7fc72014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71ffff640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b4a0 tx=0x7fc71000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710014070 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710010610 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7200b1f70 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710010a00 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.934+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7200b2530 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.935+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72006ddf0 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.936+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc710017070 con 0x7fc720070c60 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.936+0000 7fc71cff9640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 0x7fc70c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.936+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 0x7fc70c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:19.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.936+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc710089c20 con 0x7fc720070c60 2024-02-26T12:19:19.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.937+0000 7fc71f7fe640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 0x7fc70c06d9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc714036000 tx=0x7fc71403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:19.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:19.941+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc710058aa0 con 0x7fc720070c60 2024-02-26T12:19:20.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.112+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7200b7850 con 0x7fc720070c60 2024-02-26T12:19:20.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.113+0000 7fc71cff9640 1 -- 172.21.15.113:0/1957446942 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16642 (secure 0 0 0) 0x7fc7100583a0 con 0x7fc720070c60 2024-02-26T12:19:20.099 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:20.099 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":19,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:18.805795+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:20.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 msgr2=0x7fc70c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 0x7fc70c06d9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc714036000 tx=0x7fc71403c040 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 msgr2=0x7fc7200cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b4a0 tx=0x7fc71000b960 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 shutdown_connections 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc70c06b500 0x7fc70c06d9c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc72015dee0 0x7fc72014bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc72015db00 0x7fc7200b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 --2- 172.21.15.113:0/1957446942 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc720070c60 0x7fc7200cb550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 >> 172.21.15.113:0/1957446942 conn(0x7fc7200ce350 msgr2=0x7fc72015e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 shutdown_connections 2024-02-26T12:19:20.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.115+0000 7fc7263fa640 1 -- 172.21.15.113:0/1957446942 wait complete. 2024-02-26T12:19:20.111 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.229+0000 7f125cb11640 1 Processor -- start 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.229+0000 7f125cb11640 1 -- start start 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125cb11640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f125815de80 0x7f12580b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125cb11640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f12580b93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125cb11640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580b9aa0 con 0x7f12580b27d0 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125cb11640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12580b7d60 con 0x7f125815de80 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125cb11640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b8040 con 0x7f12580d11c0 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f1255d9b640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f12580b27d0 0x7f12580d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57924/0 (socket says 172.21.15.113:57924) 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f1255d9b640 1 -- 172.21.15.113:0/1154556576 learned_addr learned my addr 172.21.15.113:0/1154556576 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:20.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> v2:172.21.15.152:3300/0 conn(0x7f125815de80 0x7f12580b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.230+0000 7f1256d9d640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f12580b93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077572170 0 0) 0x7f12580b9aa0 con 0x7f12580b27d0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003520 con 0x7f12580b27d0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733627948 0 0) 0x7f1240003520 con 0x7f12580b27d0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 msgr2=0x7f12580b93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f12580b93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 >> v2:172.21.15.152:3300/0 conn(0x7f125815de80 msgr2=0x7f12580b8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 --2- 172.21.15.113:0/1154556576 >> v2:172.21.15.152:3300/0 conn(0x7f125815de80 0x7f12580b8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580b8320 con 0x7f12580b27d0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f124c001670 con 0x7f12580b27d0 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> v2:172.21.15.152:3300/0 conn(0x7f125815de80 0x7f12580b8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 >> v1:172.21.15.113:6789/0 conn(0x7f12580b27d0 legacy=0x7f12580d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12400039b0 0x7f1240003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f1240004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1240004d40 0x7f12400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b7d60 con 0x7f12400039b0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b8040 con 0x7f1240004d40 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124000b9f0 con 0x7f12580d11c0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12400039b0 0x7f1240003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f1255d9b640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f1240004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f1256d9d640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1240004d40 0x7f12400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 -- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 msgr2=0x7f1240004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f12580d11c0 0x7f1240004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 -- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1240004d40 msgr2=0x7f12400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1240004d40 0x7f12400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f125659c640 1 -- 172.21.15.113:0/1154556576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240003520 con 0x7f12400039b0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.231+0000 7f1256d9d640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1240004d40 0x7f12400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.232+0000 7f125659c640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12400039b0 0x7f1240003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f124800e350 tx=0x7f1240005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce840375400ae80 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.232+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248039070 con 0x7f12400039b0 2024-02-26T12:19:20.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.232+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124802ce00 con 0x7f12400039b0 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.232+0000 7f125559a640 1 -- 172.21.15.113:0/1154556576 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248009de0 con 0x7f12400039b0 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 -- 172.21.15.113:0/1154556576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12400039b0 msgr2=0x7f1240003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 --2- 172.21.15.113:0/1154556576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f12400039b0 0x7f1240003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f124800e350 tx=0x7f1240005830 comp rx=0 tx=0).stop 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f1256d9d640 1 -- 172.21.15.113:0/1154556576 reap_dead start 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 -- 172.21.15.113:0/1154556576 shutdown_connections 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 -- 172.21.15.113:0/1154556576 >> 172.21.15.113:0/1154556576 conn(0x7f12580726a0 msgr2=0x7f1258072ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 -- 172.21.15.113:0/1154556576 shutdown_connections 2024-02-26T12:19:20.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.233+0000 7f125cb11640 1 -- 172.21.15.113:0/1154556576 wait complete. 2024-02-26T12:19:20.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.234+0000 7f125cb11640 1 Processor -- start 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.234+0000 7f125cb11640 1 -- start start 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12400039b0 0x7f12580d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1258153290 0x7f12581604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b9520 con 0x7f1258153c50 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b93a0 con 0x7f12400039b0 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b96a0 con 0x7f1258153290 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38098/0 (socket says 172.21.15.113:38098) 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 -- 172.21.15.113:0/144402037 learned_addr learned my addr 172.21.15.113:0/144402037 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125659c640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12400039b0 0x7f12580d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1256d9d640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1258153290 0x7f12581604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 -- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1258153290 msgr2=0x7f12581604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1258153290 0x7f12581604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 -- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12400039b0 msgr2=0x7f12580d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:20.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12400039b0 0x7f12580d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 -- 172.21.15.113:0/144402037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580d1de0 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1255d9b640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f124c0073a0 tx=0x7f124c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c01a070 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00f9c0 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00fdb0 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12580d20c0 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.235+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12580d2680 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.236+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1258074a50 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.237+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f124c01d070 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.237+0000 7f1246ffd640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 0x7f123806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.237+0000 7f125659c640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 0x7f123806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.237+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f124c089b60 con 0x7f1258153c50 2024-02-26T12:19:20.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.238+0000 7f125659c640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 0x7f123806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1248036000 tx=0x7f124802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:20.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.241+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f124c058300 con 0x7f1258153c50 2024-02-26T12:19:20.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:20.454+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12580ce440 con 0x7f1258153c50 2024-02-26T12:19:21.432 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.447+0000 7f1246ffd640 1 -- 172.21.15.113:0/144402037 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f124c05c3a0 con 0x7f1258153c50 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 msgr2=0x7f123806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 0x7f123806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1248036000 tx=0x7f124802e000 comp rx=0 tx=0).stop 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 msgr2=0x7f12580d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f124c0073a0 tx=0x7f124c007860 comp rx=0 tx=0).stop 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 shutdown_connections 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f123806b4d0 0x7f123806d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1258153290 0x7f12581604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1258153c50 0x7f12580d33c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 --2- 172.21.15.113:0/144402037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f12400039b0 0x7f12580d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 >> 172.21.15.113:0/144402037 conn(0x7f12580726a0 msgr2=0x7f12580cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:21.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 shutdown_connections 2024-02-26T12:19:21.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.449+0000 7f125cb11640 1 -- 172.21.15.113:0/144402037 wait complete. 2024-02-26T12:19:21.446 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-26T12:19:21.447 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-26T12:19:21.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.565+0000 7fe8a10b7640 1 Processor -- start 2024-02-26T12:19:21.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.565+0000 7fe8a10b7640 1 -- start start 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe8a10b7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0b1790 0x7fe89c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe8a10b7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe89c15f740 0x7fe89c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe8a10b7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0b20b0 con 0x7fe89c0cc4d0 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe8a10b7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c15c780 con 0x7fe89c15f740 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe8a10b7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15ca60 con 0x7fe89c0b1790 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe89c15f740 0x7fe89c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe89c15f740 0x7fe89c0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38112/0 (socket says 172.21.15.113:38112) 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89b59e640 1 -- 172.21.15.113:0/2348292868 learned_addr learned my addr 172.21.15.113:0/2348292868 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:21.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89ad9d640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0b1790 0x7fe89c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89b59e640 1 -- 172.21.15.113:0/2348292868 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0b1790 msgr2=0x7fe89c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.566+0000 7fe89b59e640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0b1790 0x7fe89c0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe89b59e640 1 -- 172.21.15.113:0/2348292868 >> v1:172.21.15.152:6789/0 conn(0x7fe89c0cc4d0 legacy=0x7fe89c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:21.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe89b59e640 1 -- 172.21.15.113:0/2348292868 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c15cd40 con 0x7fe89c15f740 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe89b59e640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c0b0570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48505de70749aa8c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe899d9b640 1 -- 172.21.15.113:0/2348292868 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894035020 con 0x7fe89c15f740 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe899d9b640 1 -- 172.21.15.113:0/2348292868 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894031640 con 0x7fe89c15f740 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.567+0000 7fe899d9b640 1 -- 172.21.15.113:0/2348292868 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89402d040 con 0x7fe89c15f740 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 -- 172.21.15.113:0/2348292868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 msgr2=0x7fe89c0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c0b0570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 -- 172.21.15.113:0/2348292868 shutdown_connections 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c0b0570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/2348292868 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0b1790 0x7fe89c0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 -- 172.21.15.113:0/2348292868 >> 172.21.15.113:0/2348292868 conn(0x7fe89c099a40 msgr2=0x7fe89c0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:21.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 -- 172.21.15.113:0/2348292868 shutdown_connections 2024-02-26T12:19:21.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.568+0000 7fe8a10b7640 1 -- 172.21.15.113:0/2348292868 wait complete. 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.569+0000 7fe8a10b7640 1 Processor -- start 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.569+0000 7fe8a10b7640 1 -- start start 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 0x7fe89c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 0x7fe89c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0d1450 con 0x7fe89c15f740 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0b0050 con 0x7fe89c0b1790 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe8a10b7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0b0ab0 con 0x7fe89c0cc4d0 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89b59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89b59e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38122/0 (socket says 172.21.15.113:38122) 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89b59e640 1 -- 172.21.15.113:0/3960392311 learned_addr learned my addr 172.21.15.113:0/3960392311 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89b59e640 1 -- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 msgr2=0x7fe89c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89ad9d640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 0x7fe89c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.570+0000 7fe89a59c640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 0x7fe89c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89b59e640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 0x7fe89c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89b59e640 1 -- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 msgr2=0x7fe89c0c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89b59e640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 0x7fe89c0c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89b59e640 1 -- 172.21.15.113:0/3960392311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0c60a0 con 0x7fe89c15f740 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89ad9d640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 0x7fe89c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89a59c640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 0x7fe89c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe89b59e640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe89402b930 tx=0x7fe8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89403aa60 con 0x7fe89c15f740 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89403ac00 con 0x7fe89c15f740 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0c6380 con 0x7fe89c15f740 2024-02-26T12:19:21.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940443f0 con 0x7fe89c15f740 2024-02-26T12:19:21.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.571+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c0c6940 con 0x7fe89c15f740 2024-02-26T12:19:21.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.572+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c068180 con 0x7fe89c15f740 2024-02-26T12:19:21.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.572+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe894038020 con 0x7fe89c15f740 2024-02-26T12:19:21.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.573+0000 7fe8837fe640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 0x7fe88806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:21.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.573+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8940abe40 con 0x7fe89c15f740 2024-02-26T12:19:21.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.573+0000 7fe89ad9d640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 0x7fe88806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:21.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.573+0000 7fe89ad9d640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 0x7fe88806d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0cb0c0 tx=0x7fe88c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:21.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.577+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe89403f070 con 0x7fe89c15f740 2024-02-26T12:19:21.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:21.784+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe89c0d03e0 con 0x7fe89c15f740 2024-02-26T12:19:22.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.458+0000 7fe8837fe640 1 -- 172.21.15.113:0/3960392311 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe89c0d03e0 con 0x7fe89c15f740 2024-02-26T12:19:22.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 msgr2=0x7fe88806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 0x7fe88806d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0cb0c0 tx=0x7fe88c00b040 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 msgr2=0x7fe89c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe89402b930 tx=0x7fe8940046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 shutdown_connections 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe88806b4d0 0x7fe88806d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe89c15f740 0x7fe89c153260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe89c0cc4d0 0x7fe89c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 --2- 172.21.15.113:0/3960392311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe89c0b1790 0x7fe89c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 >> 172.21.15.113:0/3960392311 conn(0x7fe89c099a40 msgr2=0x7fe89c06e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 shutdown_connections 2024-02-26T12:19:22.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.460+0000 7fe8a10b7640 1 -- 172.21.15.113:0/3960392311 wait complete. 2024-02-26T12:19:22.456 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-26T12:19:22.457 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.572+0000 7f687291e640 1 Processor -- start 2024-02-26T12:19:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.572+0000 7f687291e640 1 -- start start 2024-02-26T12:19:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f687291e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f686c15db00 0x7f686c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f687291e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f686c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f687291e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c0711d0 con 0x7f686c070c60 2024-02-26T12:19:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f687291e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0714b0 con 0x7f686c15db00 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f687291e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c071790 con 0x7f686c15dee0 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f6870ebb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f686c070c60 0x7f686c161840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57926/0 (socket says 172.21.15.113:57926) 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f6870ebb640 1 -- 172.21.15.113:0/1139268928 learned_addr learned my addr 172.21.15.113:0/1139268928 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447915207 0 0) 0x7f686c0711d0 con 0x7f686c070c60 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6854003520 con 0x7f686c070c60 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f686bfff640 1 --2- 172.21.15.113:0/1139268928 >> v2:172.21.15.152:3300/0 conn(0x7f686c15db00 0x7f686c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.573+0000 7f686b7fe640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f686c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014685044 0 0) 0x7f6854003520 con 0x7f686c070c60 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 msgr2=0x7f686c0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f686c0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 >> v2:172.21.15.152:3300/0 conn(0x7f686c15db00 msgr2=0x7f686c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 --2- 172.21.15.113:0/1139268928 >> v2:172.21.15.152:3300/0 conn(0x7f686c15db00 0x7f686c0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c071a70 con 0x7f686c070c60 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f68640019f0 con 0x7f686c070c60 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 >> v1:172.21.15.113:6789/0 conn(0x7f686c070c60 legacy=0x7f686c161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68540039b0 0x7f6854003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f6854004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6854004d40 0x7f68540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0714b0 con 0x7f6854004d40 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c071790 con 0x7f68540039b0 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685400b9c0 con 0x7f686c15dee0 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6854004d40 0x7f68540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686bfff640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68540039b0 0x7f6854003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f686b7fe640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f6854004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 -- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 msgr2=0x7f6854004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f686c15dee0 0x7f6854004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 -- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68540039b0 msgr2=0x7f6854003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f68540039b0 0x7f6854003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.574+0000 7f6870ebb640 1 -- 172.21.15.113:0/1139268928 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854003520 con 0x7f6854004d40 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f6870ebb640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6854004d40 0x7f68540051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f686400a860 tx=0x7f6854005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e592e90709b9aea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400a480 con 0x7f6854004d40 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864034630 con 0x7f6854004d40 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f686affd640 1 -- 172.21.15.113:0/1139268928 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864034a60 con 0x7f6854004d40 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f687291e640 1 -- 172.21.15.113:0/1139268928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6854004d40 msgr2=0x7f68540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f687291e640 1 --2- 172.21.15.113:0/1139268928 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6854004d40 0x7f68540051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f686400a860 tx=0x7f6854005830 comp rx=0 tx=0).stop 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f6870ebb640 1 -- 172.21.15.113:0/1139268928 reap_dead start 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f687291e640 1 -- 172.21.15.113:0/1139268928 shutdown_connections 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f687291e640 1 -- 172.21.15.113:0/1139268928 >> 172.21.15.113:0/1139268928 conn(0x7f686c0ce350 msgr2=0x7f686c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.575+0000 7f687291e640 1 -- 172.21.15.113:0/1139268928 shutdown_connections 2024-02-26T12:19:22.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.576+0000 7f687291e640 1 -- 172.21.15.113:0/1139268928 wait complete. 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 Processor -- start 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 -- start start 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6854004d40 0x7f686c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f686c1f3b90 0x7f686c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.577+0000 7f687291e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c06c150 con 0x7f686c1f7da0 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f687291e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0d03f0 con 0x7f686c1f3b90 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f687291e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c06c2d0 con 0x7f6854004d40 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38152/0 (socket says 172.21.15.113:38152) 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 -- 172.21.15.113:0/733827758 learned_addr learned my addr 172.21.15.113:0/733827758 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f6870ebb640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f686c1f3b90 0x7f686c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686bfff640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6854004d40 0x7f686c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 -- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6854004d40 msgr2=0x7f686c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6854004d40 0x7f686c15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 -- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f686c1f3b90 msgr2=0x7f686c1f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f686c1f3b90 0x7f686c1f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 -- 172.21.15.113:0/733827758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c15c700 con 0x7f686c1f7da0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f686b7fe640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68600119d0 tx=0x7f6860011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000faf0 con 0x7f686c1f7da0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000fc90 con 0x7f686c1f7da0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c0b1610 con 0x7f686c1f7da0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860014440 con 0x7f686c1f7da0 2024-02-26T12:19:22.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.578+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c0b1bd0 con 0x7f686c1f7da0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.579+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c074a50 con 0x7f686c1f7da0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.579+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6860012040 con 0x7f686c1f7da0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.580+0000 7f6868ff9640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 0x7f685806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.580+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f686008a8b0 con 0x7f686c1f7da0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.580+0000 7f686bfff640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 0x7f685806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.580+0000 7f686bfff640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 0x7f685806d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f685c009a00 tx=0x7f685c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.584+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6860019030 con 0x7f686c1f7da0 2024-02-26T12:19:22.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.791+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f686c06c8c0 con 0x7f686c1f7da0 2024-02-26T12:19:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.791+0000 7f6868ff9640 1 -- 172.21.15.113:0/733827758 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f68600596a0 con 0x7f686c1f7da0 2024-02-26T12:19:22.777 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:22.777 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:22.777 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.793+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 msgr2=0x7f685806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.793+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 0x7f685806d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f685c009a00 tx=0x7f685c008040 comp rx=0 tx=0).stop 2024-02-26T12:19:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.793+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 msgr2=0x7f686c0b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.793+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f68600119d0 tx=0x7f6860011e90 comp rx=0 tx=0).stop 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 shutdown_connections 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f685806b500 0x7f685806d9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f686c1f3b90 0x7f686c1f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f686c1f7da0 0x7f686c0b0dc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 --2- 172.21.15.113:0/733827758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6854004d40 0x7f686c15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 >> 172.21.15.113:0/733827758 conn(0x7f686c0ce350 msgr2=0x7f686c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 shutdown_connections 2024-02-26T12:19:22.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.794+0000 7f687291e640 1 -- 172.21.15.113:0/733827758 wait complete. 2024-02-26T12:19:22.789 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:22.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.904+0000 7f342b984640 1 Processor -- start 2024-02-26T12:19:22.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.904+0000 7f342b984640 1 -- start start 2024-02-26T12:19:22.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 0x7f34240b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34240b1a60 0x7f34240b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 0x7f342415f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240c4110 con 0x7f34240b1a60 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342406b800 con 0x7f342415f1c0 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f342b984640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240b1280 con 0x7f34240b0df0 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f3428f1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34240b1a60 0x7f34240b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f3428f1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f34240b1a60 0x7f34240b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38156/0 (socket says 172.21.15.113:38156) 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f3428f1f640 1 -- 172.21.15.113:0/1996036513 learned_addr learned my addr 172.21.15.113:0/1996036513 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f3429f21640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 0x7f342415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.905+0000 7f3429720640 1 --2- 172.21.15.113:0/1996036513 >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 0x7f34240b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 -- 172.21.15.113:0/1996036513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 msgr2=0x7f342415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 0x7f342415f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 -- 172.21.15.113:0/1996036513 >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 msgr2=0x7f34240b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 --2- 172.21.15.113:0/1996036513 >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 0x7f34240b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 -- 172.21.15.113:0/1996036513 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342406abf0 con 0x7f34240b1a60 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3429f21640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 0x7f342415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3429720640 1 --2- 172.21.15.113:0/1996036513 >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 0x7f34240b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f3428f1f640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b1a60 0x7f34240b08b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da2749932a1a784 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f341bfff640 1 -- 172.21.15.113:0/1996036513 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414035020 con 0x7f34240b1a60 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f341bfff640 1 -- 172.21.15.113:0/1996036513 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414031640 con 0x7f34240b1a60 2024-02-26T12:19:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.906+0000 7f341bfff640 1 -- 172.21.15.113:0/1996036513 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341402d040 con 0x7f34240b1a60 2024-02-26T12:19:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 -- 172.21.15.113:0/1996036513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b1a60 msgr2=0x7f34240b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b1a60 0x7f34240b08b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3414009870 tx=0x7f341402b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 -- 172.21.15.113:0/1996036513 shutdown_connections 2024-02-26T12:19:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34240b0df0 0x7f342415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 --2- 172.21.15.113:0/1996036513 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b1a60 0x7f34240b08b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 --2- 172.21.15.113:0/1996036513 >> v2:172.21.15.152:3300/0 conn(0x7f342415f1c0 0x7f34240b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 -- 172.21.15.113:0/1996036513 >> 172.21.15.113:0/1996036513 conn(0x7f34240d0760 msgr2=0x7f34240d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 -- 172.21.15.113:0/1996036513 shutdown_connections 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.907+0000 7f342b984640 1 -- 172.21.15.113:0/1996036513 wait complete. 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.908+0000 7f342b984640 1 Processor -- start 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.908+0000 7f342b984640 1 -- start start 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34240b1a60 0x7f34240c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 0x7f34240c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342406b490 con 0x7f34240b0df0 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342406b1b0 con 0x7f34240b1a60 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f342b984640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342415fc80 con 0x7f342415f1c0 2024-02-26T12:19:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38162/0 (socket says 172.21.15.113:38162) 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 -- 172.21.15.113:0/395858113 learned_addr learned my addr 172.21.15.113:0/395858113 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3428f1f640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34240b1a60 0x7f34240c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429f21640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 0x7f34240c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 -- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 msgr2=0x7f34240c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 0x7f34240c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 -- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34240b1a60 msgr2=0x7f34240c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34240b1a60 0x7f34240c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 -- 172.21.15.113:0/395858113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424155280 con 0x7f34240b0df0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429f21640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 0x7f34240c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.909+0000 7f3429720640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3420007f20 tx=0x7f342000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.910+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342001a070 con 0x7f34240b0df0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.910+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420003b90 con 0x7f34240b0df0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.910+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34240c5380 con 0x7f34240b0df0 2024-02-26T12:19:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.910+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420004030 con 0x7f34240b0df0 2024-02-26T12:19:22.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.910+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34240c5940 con 0x7f34240b0df0 2024-02-26T12:19:22.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.911+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240b65e0 con 0x7f34240b0df0 2024-02-26T12:19:22.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.911+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f342001d070 con 0x7f34240b0df0 2024-02-26T12:19:22.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.911+0000 7f3419ffb640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 0x7f340806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:22.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.912+0000 7f3428f1f640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 0x7f340806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.912+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f342008a2d0 con 0x7f34240b0df0 2024-02-26T12:19:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.912+0000 7f3428f1f640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 0x7f340806d9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3414036000 tx=0x7f341403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:22.916+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3424155280 con 0x7f34240b0df0 2024-02-26T12:19:23.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.086+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34240af940 con 0x7f34240b0df0 2024-02-26T12:19:23.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.087+0000 7f3419ffb640 1 -- 172.21.15.113:0/395858113 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f3420010070 con 0x7f34240b0df0 2024-02-26T12:19:23.073 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:23.073 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 msgr2=0x7f340806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 0x7f340806d9c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3414036000 tx=0x7f341403c040 comp rx=0 tx=0).stop 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 msgr2=0x7f3424154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3420007f20 tx=0x7f342000d560 comp rx=0 tx=0).stop 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 shutdown_connections 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f340806b500 0x7f340806d9c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f342415f1c0 0x7f34240c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34240b1a60 0x7f34240c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 --2- 172.21.15.113:0/395858113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34240b0df0 0x7f3424154d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 >> 172.21.15.113:0/395858113 conn(0x7f34240d0760 msgr2=0x7f342406faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 shutdown_connections 2024-02-26T12:19:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.089+0000 7f342b984640 1 -- 172.21.15.113:0/395858113 wait complete. 2024-02-26T12:19:23.085 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-26T12:19:23.086 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:19:23.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.201+0000 7fb7e042d640 1 Processor -- start 2024-02-26T12:19:23.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.201+0000 7fb7e042d640 1 -- start start 2024-02-26T12:19:23.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7e042d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d815def0 0x7fb7d80b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7e042d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d80b2d80 0x7fb7d80d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7e042d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80d1f50 con 0x7fb7d80d3530 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7e042d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80d2230 con 0x7fb7d80b2d80 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7e042d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80d2510 con 0x7fb7d815def0 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7de9ca640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb7d80d3530 0x7fb7d80ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57936/0 (socket says 172.21.15.113:57936) 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7de9ca640 1 -- 172.21.15.113:0/1832388001 learned_addr learned my addr 172.21.15.113:0/1832388001 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd9c8640 1 --2- 172.21.15.113:0/1832388001 >> v2:172.21.15.152:3300/0 conn(0x7fb7d80b2d80 0x7fb7d80d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d815def0 0x7fb7d80b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753792149 0 0) 0x7fb7d80d1f50 con 0x7fb7d80d3530 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c4003520 con 0x7fb7d80d3530 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 495040031 0 0) 0x7fb7c4003520 con 0x7fb7d80d3530 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d815def0 msgr2=0x7fb7d80b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d815def0 0x7fb7d80b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 >> v2:172.21.15.152:3300/0 conn(0x7fb7d80b2d80 msgr2=0x7fb7d80d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 --2- 172.21.15.113:0/1832388001 >> v2:172.21.15.152:3300/0 conn(0x7fb7d80b2d80 0x7fb7d80d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80d27f0 con 0x7fb7d80d3530 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fb7d00019f0 con 0x7fb7d80d3530 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 >> v1:172.21.15.113:6789/0 conn(0x7fb7d80d3530 legacy=0x7fb7d80ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c4004800 0x7fb7c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7c40051c0 0x7fb7c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80d2230 con 0x7fb7c40039b0 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80d2510 con 0x7fb7c4004800 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40045a0 con 0x7fb7c40051c0 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.202+0000 7fb7dd9c8640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c4004800 0x7fb7c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de9ca640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7c40051c0 0x7fb7c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 -- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7c40051c0 msgr2=0x7fb7c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7c40051c0 0x7fb7c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 -- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c4004800 msgr2=0x7fb7c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7c4004800 0x7fb7c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 -- 172.21.15.113:0/1832388001 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4003520 con 0x7fb7c40039b0 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de9ca640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7c40051c0 0x7fb7c400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7c4003dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009af0 tx=0x7fb7c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee450dd2361ce67 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.203+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4039070 con 0x7fb7c40039b0 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d402c6b0 con 0x7fb7c40039b0 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7dd1c7640 1 -- 172.21.15.113:0/1832388001 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4009690 con 0x7fb7c40039b0 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 -- 172.21.15.113:0/1832388001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 msgr2=0x7fb7c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 --2- 172.21.15.113:0/1832388001 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7c4003dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009af0 tx=0x7fb7c4005830 comp rx=0 tx=0).stop 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7de9ca640 1 -- 172.21.15.113:0/1832388001 reap_dead start 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 -- 172.21.15.113:0/1832388001 shutdown_connections 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 -- 172.21.15.113:0/1832388001 >> 172.21.15.113:0/1832388001 conn(0x7fb7d80728b0 msgr2=0x7fb7d80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 -- 172.21.15.113:0/1832388001 shutdown_connections 2024-02-26T12:19:23.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.204+0000 7fb7e042d640 1 -- 172.21.15.113:0/1832388001 wait complete. 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.205+0000 7fb7e042d640 1 Processor -- start 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.205+0000 7fb7e042d640 1 -- start start 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d80ad670 0x7fb7d814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d814f1d0 0x7fb7d80b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80cf140 con 0x7fb7c40039b0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80cefc0 con 0x7fb7d814f1d0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7e042d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80b9400 con 0x7fb7d80ad670 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38180/0 (socket says 172.21.15.113:38180) 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 -- 172.21.15.113:0/3653376174 learned_addr learned my addr 172.21.15.113:0/3653376174 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 -- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d80ad670 msgr2=0x7fb7d814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d80ad670 0x7fb7d814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 -- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d814f1d0 msgr2=0x7fb7d80b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d814f1d0 0x7fb7d80b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.206+0000 7fb7de1c9640 1 -- 172.21.15.113:0/3653376174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d814f6f0 con 0x7fb7c40039b0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7de1c9640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000c00 tx=0x7fb7d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4042020 con 0x7fb7c40039b0 2024-02-26T12:19:23.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d403a040 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d814f9d0 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4039070 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.207+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d814d060 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.208+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d8074a50 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.208+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7d4045020 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.208+0000 7fb7ceffd640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 0x7fb7bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.209+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d40ab5f0 con 0x7fb7c40039b0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.209+0000 7fb7dd9c8640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 0x7fb7bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.209+0000 7fb7dd9c8640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 0x7fb7bc06d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8006e80 tx=0x7fb7c8006df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.213+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7d404c070 con 0x7fb7c40039b0 2024-02-26T12:19:23.367 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.382+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7d814fba0 con 0x7fb7bc06b500 2024-02-26T12:19:23.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.388+0000 7fb7ceffd640 1 -- 172.21.15.113:0/3653376174 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fb7d814fba0 con 0x7fb7bc06b500 2024-02-26T12:19:23.376 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:23.378 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:19:23.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.391+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 msgr2=0x7fb7bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.391+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 0x7fb7bc06d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8006e80 tx=0x7fb7c8006df0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.391+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 msgr2=0x7fb7d80ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.391+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000c00 tx=0x7fb7d4004730 comp rx=0 tx=0).stop 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 shutdown_connections 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb7bc06b500 0x7fb7bc06d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d814f1d0 0x7fb7d80b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb7d80ad670 0x7fb7d814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 --2- 172.21.15.113:0/3653376174 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7c40039b0 0x7fb7d80ad130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 >> 172.21.15.113:0/3653376174 conn(0x7fb7d80728b0 msgr2=0x7fb7d81602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 shutdown_connections 2024-02-26T12:19:23.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.392+0000 7fb7e042d640 1 -- 172.21.15.113:0/3653376174 wait complete. 2024-02-26T12:19:23.387 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-02-26T12:19:23.156187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218908,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755812,"statfs":{"total":773094113280,"available":772869951488,"internally_reserved":0,"allocated":2805760,"data_stored":1708928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.717484"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933043+0000","last_change":"2024-02-26T12:19:19.469679+0000","last_active":"2024-02-26T12:19:20.933043+0000","last_peered":"2024-02-26T12:19:20.933043+0000","last_clean":"2024-02-26T12:19:20.933043+0000","last_became_active":"2024-02-26T12:19:19.469330+0000","last_became_peered":"2024-02-26T12:19:19.469330+0000","last_unstale":"2024-02-26T12:19:20.933043+0000","last_undegraded":"2024-02-26T12:19:20.933043+0000","last_fullsized":"2024-02-26T12:19:20.933043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449495+0000","last_change":"2024-02-26T12:19:19.464902+0000","last_active":"2024-02-26T12:19:20.449495+0000","last_peered":"2024-02-26T12:19:20.449495+0000","last_clean":"2024-02-26T12:19:20.449495+0000","last_became_active":"2024-02-26T12:19:19.464146+0000","last_became_peered":"2024-02-26T12:19:19.464146+0000","last_unstale":"2024-02-26T12:19:20.449495+0000","last_undegraded":"2024-02-26T12:19:20.449495+0000","last_fullsized":"2024-02-26T12:19:20.449495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933290+0000","last_change":"2024-02-26T12:19:19.455501+0000","last_active":"2024-02-26T12:19:20.933290+0000","last_peered":"2024-02-26T12:19:20.933290+0000","last_clean":"2024-02-26T12:19:20.933290+0000","last_became_active":"2024-02-26T12:19:19.455220+0000","last_became_peered":"2024-02-26T12:19:19.455220+0000","last_unstale":"2024-02-26T12:19:20.933290+0000","last_undegraded":"2024-02-26T12:19:20.933290+0000","last_fullsized":"2024-02-26T12:19:20.933290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:18.000356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452612+0000","last_change":"2024-02-26T12:19:19.463628+0000","last_active":"2024-02-26T12:19:20.452612+0000","last_peered":"2024-02-26T12:19:20.452612+0000","last_clean":"2024-02-26T12:19:20.452612+0000","last_became_active":"2024-02-26T12:19:19.463142+0000","last_became_peered":"2024-02-26T12:19:19.463142+0000","last_unstale":"2024-02-26T12:19:20.452612+0000","last_undegraded":"2024-02-26T12:19:20.452612+0000","last_fullsized":"2024-02-26T12:19:20.452612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932648+0000","last_change":"2024-02-26T12:19:19.474833+0000","last_active":"2024-02-26T12:19:20.932648+0000","last_peered":"2024-02-26T12:19:20.932648+0000","last_clean":"2024-02-26T12:19:20.932648+0000","last_became_active":"2024-02-26T12:19:19.474460+0000","last_became_peered":"2024-02-26T12:19:19.474460+0000","last_unstale":"2024-02-26T12:19:20.932648+0000","last_undegraded":"2024-02-26T12:19:20.932648+0000","last_fullsized":"2024-02-26T12:19:20.932648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452346+0000","last_change":"2024-02-26T12:19:19.465004+0000","last_active":"2024-02-26T12:19:20.452346+0000","last_peered":"2024-02-26T12:19:20.452346+0000","last_clean":"2024-02-26T12:19:20.452346+0000","last_became_active":"2024-02-26T12:19:19.464746+0000","last_became_peered":"2024-02-26T12:19:19.464746+0000","last_unstale":"2024-02-26T12:19:20.452346+0000","last_undegraded":"2024-02-26T12:19:20.452346+0000","last_fullsized":"2024-02-26T12:19:20.452346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932594+0000","last_change":"2024-02-26T12:19:19.472236+0000","last_active":"2024-02-26T12:19:20.932594+0000","last_peered":"2024-02-26T12:19:20.932594+0000","last_clean":"2024-02-26T12:19:20.932594+0000","last_became_active":"2024-02-26T12:19:19.471857+0000","last_became_peered":"2024-02-26T12:19:19.471857+0000","last_unstale":"2024-02-26T12:19:20.932594+0000","last_undegraded":"2024-02-26T12:19:20.932594+0000","last_fullsized":"2024-02-26T12:19:20.932594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932555+0000","last_change":"2024-02-26T12:19:19.471776+0000","last_active":"2024-02-26T12:19:20.932555+0000","last_peered":"2024-02-26T12:19:20.932555+0000","last_clean":"2024-02-26T12:19:20.932555+0000","last_became_active":"2024-02-26T12:19:19.471502+0000","last_became_peered":"2024-02-26T12:19:19.471502+0000","last_unstale":"2024-02-26T12:19:20.932555+0000","last_undegraded":"2024-02-26T12:19:20.932555+0000","last_fullsized":"2024-02-26T12:19:20.932555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933050+0000","last_change":"2024-02-26T12:19:19.477637+0000","last_active":"2024-02-26T12:19:20.933050+0000","last_peered":"2024-02-26T12:19:20.933050+0000","last_clean":"2024-02-26T12:19:20.933050+0000","last_became_active":"2024-02-26T12:19:19.476957+0000","last_became_peered":"2024-02-26T12:19:19.476957+0000","last_unstale":"2024-02-26T12:19:20.933050+0000","last_undegraded":"2024-02-26T12:19:20.933050+0000","last_fullsized":"2024-02-26T12:19:20.933050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:09:58.291307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469618+0000","last_change":"2024-02-26T12:19:19.463237+0000","last_active":"2024-02-26T12:19:20.469618+0000","last_peered":"2024-02-26T12:19:20.469618+0000","last_clean":"2024-02-26T12:19:20.469618+0000","last_became_active":"2024-02-26T12:19:19.462923+0000","last_became_peered":"2024-02-26T12:19:19.462923+0000","last_unstale":"2024-02-26T12:19:20.469618+0000","last_undegraded":"2024-02-26T12:19:20.469618+0000","last_fullsized":"2024-02-26T12:19:20.469618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469534+0000","last_change":"2024-02-26T12:19:19.469387+0000","last_active":"2024-02-26T12:19:20.469534+0000","last_peered":"2024-02-26T12:19:20.469534+0000","last_clean":"2024-02-26T12:19:20.469534+0000","last_became_active":"2024-02-26T12:19:19.469106+0000","last_became_peered":"2024-02-26T12:19:19.469106+0000","last_unstale":"2024-02-26T12:19:20.469534+0000","last_undegraded":"2024-02-26T12:19:20.469534+0000","last_fullsized":"2024-02-26T12:19:20.469534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453265+0000","last_change":"2024-02-26T12:19:19.462424+0000","last_active":"2024-02-26T12:19:20.453265+0000","last_peered":"2024-02-26T12:19:20.453265+0000","last_clean":"2024-02-26T12:19:20.453265+0000","last_became_active":"2024-02-26T12:19:19.462155+0000","last_became_peered":"2024-02-26T12:19:19.462155+0000","last_unstale":"2024-02-26T12:19:20.453265+0000","last_undegraded":"2024-02-26T12:19:20.453265+0000","last_fullsized":"2024-02-26T12:19:20.453265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932944+0000","last_change":"2024-02-26T12:19:19.468734+0000","last_active":"2024-02-26T12:19:20.932944+0000","last_peered":"2024-02-26T12:19:20.932944+0000","last_clean":"2024-02-26T12:19:20.932944+0000","last_became_active":"2024-02-26T12:19:19.468362+0000","last_became_peered":"2024-02-26T12:19:19.468362+0000","last_unstale":"2024-02-26T12:19:20.932944+0000","last_undegraded":"2024-02-26T12:19:20.932944+0000","last_fullsized":"2024-02-26T12:19:20.932944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933218+0000","last_change":"2024-02-26T12:19:19.458457+0000","last_active":"2024-02-26T12:19:20.933218+0000","last_peered":"2024-02-26T12:19:20.933218+0000","last_clean":"2024-02-26T12:19:20.933218+0000","last_became_active":"2024-02-26T12:19:19.458167+0000","last_became_peered":"2024-02-26T12:19:19.458167+0000","last_unstale":"2024-02-26T12:19:20.933218+0000","last_undegraded":"2024-02-26T12:19:20.933218+0000","last_fullsized":"2024-02-26T12:19:20.933218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:34:16.814402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449347+0000","last_change":"2024-02-26T12:19:19.457554+0000","last_active":"2024-02-26T12:19:20.449347+0000","last_peered":"2024-02-26T12:19:20.449347+0000","last_clean":"2024-02-26T12:19:20.449347+0000","last_became_active":"2024-02-26T12:19:19.457255+0000","last_became_peered":"2024-02-26T12:19:19.457255+0000","last_unstale":"2024-02-26T12:19:20.449347+0000","last_undegraded":"2024-02-26T12:19:20.449347+0000","last_fullsized":"2024-02-26T12:19:20.449347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452064+0000","last_change":"2024-02-26T12:19:19.454291+0000","last_active":"2024-02-26T12:19:20.452064+0000","last_peered":"2024-02-26T12:19:20.452064+0000","last_clean":"2024-02-26T12:19:20.452064+0000","last_became_active":"2024-02-26T12:19:19.454008+0000","last_became_peered":"2024-02-26T12:19:19.454008+0000","last_unstale":"2024-02-26T12:19:20.452064+0000","last_undegraded":"2024-02-26T12:19:20.452064+0000","last_fullsized":"2024-02-26T12:19:20.452064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453519+0000","last_change":"2024-02-26T12:19:19.470053+0000","last_active":"2024-02-26T12:19:20.453519+0000","last_peered":"2024-02-26T12:19:20.453519+0000","last_clean":"2024-02-26T12:19:20.453519+0000","last_became_active":"2024-02-26T12:19:19.469775+0000","last_became_peered":"2024-02-26T12:19:19.469775+0000","last_unstale":"2024-02-26T12:19:20.453519+0000","last_undegraded":"2024-02-26T12:19:20.453519+0000","last_fullsized":"2024-02-26T12:19:20.453519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932459+0000","last_change":"2024-02-26T12:19:19.467381+0000","last_active":"2024-02-26T12:19:20.932459+0000","last_peered":"2024-02-26T12:19:20.932459+0000","last_clean":"2024-02-26T12:19:20.932459+0000","last_became_active":"2024-02-26T12:19:19.467003+0000","last_became_peered":"2024-02-26T12:19:19.467003+0000","last_unstale":"2024-02-26T12:19:20.932459+0000","last_undegraded":"2024-02-26T12:19:20.932459+0000","last_fullsized":"2024-02-26T12:19:20.932459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932943+0000","last_change":"2024-02-26T12:19:19.472512+0000","last_active":"2024-02-26T12:19:20.932943+0000","last_peered":"2024-02-26T12:19:20.932943+0000","last_clean":"2024-02-26T12:19:20.932943+0000","last_became_active":"2024-02-26T12:19:19.472179+0000","last_became_peered":"2024-02-26T12:19:19.472179+0000","last_unstale":"2024-02-26T12:19:20.932943+0000","last_undegraded":"2024-02-26T12:19:20.932943+0000","last_fullsized":"2024-02-26T12:19:20.932943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469423+0000","last_change":"2024-02-26T12:19:19.458929+0000","last_active":"2024-02-26T12:19:20.469423+0000","last_peered":"2024-02-26T12:19:20.469423+0000","last_clean":"2024-02-26T12:19:20.469423+0000","last_became_active":"2024-02-26T12:19:19.458670+0000","last_became_peered":"2024-02-26T12:19:19.458670+0000","last_unstale":"2024-02-26T12:19:20.469423+0000","last_undegraded":"2024-02-26T12:19:20.469423+0000","last_fullsized":"2024-02-26T12:19:20.469423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933262+0000","last_change":"2024-02-26T12:19:19.474768+0000","last_active":"2024-02-26T12:19:20.933262+0000","last_peered":"2024-02-26T12:19:20.933262+0000","last_clean":"2024-02-26T12:19:20.933262+0000","last_became_active":"2024-02-26T12:19:19.474509+0000","last_became_peered":"2024-02-26T12:19:19.474509+0000","last_unstale":"2024-02-26T12:19:20.933262+0000","last_undegraded":"2024-02-26T12:19:20.933262+0000","last_fullsized":"2024-02-26T12:19:20.933262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:18:43.353358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452428+0000","last_change":"2024-02-26T12:19:19.469403+0000","last_active":"2024-02-26T12:19:20.452428+0000","last_peered":"2024-02-26T12:19:20.452428+0000","last_clean":"2024-02-26T12:19:20.452428+0000","last_became_active":"2024-02-26T12:19:19.469137+0000","last_became_peered":"2024-02-26T12:19:19.469137+0000","last_unstale":"2024-02-26T12:19:20.452428+0000","last_undegraded":"2024-02-26T12:19:20.452428+0000","last_fullsized":"2024-02-26T12:19:20.452428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932447+0000","last_change":"2024-02-26T12:19:19.459664+0000","last_active":"2024-02-26T12:19:20.932447+0000","last_peered":"2024-02-26T12:19:20.932447+0000","last_clean":"2024-02-26T12:19:20.932447+0000","last_became_active":"2024-02-26T12:19:19.459409+0000","last_became_peered":"2024-02-26T12:19:19.459409+0000","last_unstale":"2024-02-26T12:19:20.932447+0000","last_undegraded":"2024-02-26T12:19:20.932447+0000","last_fullsized":"2024-02-26T12:19:20.932447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452126+0000","last_change":"2024-02-26T12:19:19.465721+0000","last_active":"2024-02-26T12:19:20.452126+0000","last_peered":"2024-02-26T12:19:20.452126+0000","last_clean":"2024-02-26T12:19:20.452126+0000","last_became_active":"2024-02-26T12:19:19.465390+0000","last_became_peered":"2024-02-26T12:19:19.465390+0000","last_unstale":"2024-02-26T12:19:20.452126+0000","last_undegraded":"2024-02-26T12:19:20.452126+0000","last_fullsized":"2024-02-26T12:19:20.452126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932702+0000","last_change":"2024-02-26T12:19:19.461546+0000","last_active":"2024-02-26T12:19:20.932702+0000","last_peered":"2024-02-26T12:19:20.932702+0000","last_clean":"2024-02-26T12:19:20.932702+0000","last_became_active":"2024-02-26T12:19:19.461235+0000","last_became_peered":"2024-02-26T12:19:19.461235+0000","last_unstale":"2024-02-26T12:19:20.932702+0000","last_undegraded":"2024-02-26T12:19:20.932702+0000","last_fullsized":"2024-02-26T12:19:20.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469664+0000","last_change":"2024-02-26T12:19:19.470118+0000","last_active":"2024-02-26T12:19:20.469664+0000","last_peered":"2024-02-26T12:19:20.469664+0000","last_clean":"2024-02-26T12:19:20.469664+0000","last_became_active":"2024-02-26T12:19:19.469859+0000","last_became_peered":"2024-02-26T12:19:19.469859+0000","last_unstale":"2024-02-26T12:19:20.469664+0000","last_undegraded":"2024-02-26T12:19:20.469664+0000","last_fullsized":"2024-02-26T12:19:20.469664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449593+0000","last_change":"2024-02-26T12:19:19.461901+0000","last_active":"2024-02-26T12:19:20.449593+0000","last_peered":"2024-02-26T12:19:20.449593+0000","last_clean":"2024-02-26T12:19:20.449593+0000","last_became_active":"2024-02-26T12:19:19.461611+0000","last_became_peered":"2024-02-26T12:19:19.461611+0000","last_unstale":"2024-02-26T12:19:20.449593+0000","last_undegraded":"2024-02-26T12:19:20.449593+0000","last_fullsized":"2024-02-26T12:19:20.449593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.466246+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.465853+0000","last_became_peered":"2024-02-26T12:19:19.465853+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933418+0000","last_change":"2024-02-26T12:19:19.462596+0000","last_active":"2024-02-26T12:19:20.933418+0000","last_peered":"2024-02-26T12:19:20.933418+0000","last_clean":"2024-02-26T12:19:20.933418+0000","last_became_active":"2024-02-26T12:19:19.462151+0000","last_became_peered":"2024-02-26T12:19:19.462151+0000","last_unstale":"2024-02-26T12:19:20.933418+0000","last_undegraded":"2024-02-26T12:19:20.933418+0000","last_fullsized":"2024-02-26T12:19:20.933418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452517+0000","last_change":"2024-02-26T12:19:19.463840+0000","last_active":"2024-02-26T12:19:20.452517+0000","last_peered":"2024-02-26T12:19:20.452517+0000","last_clean":"2024-02-26T12:19:20.452517+0000","last_became_active":"2024-02-26T12:19:19.462936+0000","last_became_peered":"2024-02-26T12:19:19.462936+0000","last_unstale":"2024-02-26T12:19:20.452517+0000","last_undegraded":"2024-02-26T12:19:20.452517+0000","last_fullsized":"2024-02-26T12:19:20.452517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932299+0000","last_change":"2024-02-26T12:19:19.463407+0000","last_active":"2024-02-26T12:19:20.932299+0000","last_peered":"2024-02-26T12:19:20.932299+0000","last_clean":"2024-02-26T12:19:20.932299+0000","last_became_active":"2024-02-26T12:19:19.463126+0000","last_became_peered":"2024-02-26T12:19:19.463126+0000","last_unstale":"2024-02-26T12:19:20.932299+0000","last_undegraded":"2024-02-26T12:19:20.932299+0000","last_fullsized":"2024-02-26T12:19:20.932299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469300+0000","last_change":"2024-02-26T12:19:19.466527+0000","last_active":"2024-02-26T12:19:20.469300+0000","last_peered":"2024-02-26T12:19:20.469300+0000","last_clean":"2024-02-26T12:19:20.469300+0000","last_became_active":"2024-02-26T12:19:19.466230+0000","last_became_peered":"2024-02-26T12:19:19.466230+0000","last_unstale":"2024-02-26T12:19:20.469300+0000","last_undegraded":"2024-02-26T12:19:20.469300+0000","last_fullsized":"2024-02-26T12:19:20.469300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453228+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.453228+0000","last_peered":"2024-02-26T12:19:20.453228+0000","last_clean":"2024-02-26T12:19:20.453228+0000","last_became_active":"2024-02-26T12:19:19.458585+0000","last_became_peered":"2024-02-26T12:19:19.458585+0000","last_unstale":"2024-02-26T12:19:20.453228+0000","last_undegraded":"2024-02-26T12:19:20.453228+0000","last_fullsized":"2024-02-26T12:19:20.453228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932859+0000","last_change":"2024-02-26T12:19:18.462238+0000","last_active":"2024-02-26T12:19:20.932859+0000","last_peered":"2024-02-26T12:19:20.932859+0000","last_clean":"2024-02-26T12:19:20.932859+0000","last_became_active":"2024-02-26T12:19:18.461454+0000","last_became_peered":"2024-02-26T12:19:18.461454+0000","last_unstale":"2024-02-26T12:19:20.932859+0000","last_undegraded":"2024-02-26T12:19:20.932859+0000","last_fullsized":"2024-02-26T12:19:20.932859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933404+0000","last_change":"2024-02-26T12:19:19.454565+0000","last_active":"2024-02-26T12:19:20.933404+0000","last_peered":"2024-02-26T12:19:20.933404+0000","last_clean":"2024-02-26T12:19:20.933404+0000","last_became_active":"2024-02-26T12:19:19.454147+0000","last_became_peered":"2024-02-26T12:19:19.454147+0000","last_unstale":"2024-02-26T12:19:20.933404+0000","last_undegraded":"2024-02-26T12:19:20.933404+0000","last_fullsized":"2024-02-26T12:19:20.933404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469231+0000","last_change":"2024-02-26T12:19:18.462539+0000","last_active":"2024-02-26T12:19:20.469231+0000","last_peered":"2024-02-26T12:19:20.469231+0000","last_clean":"2024-02-26T12:19:20.469231+0000","last_became_active":"2024-02-26T12:19:18.462256+0000","last_became_peered":"2024-02-26T12:19:18.462256+0000","last_unstale":"2024-02-26T12:19:20.469231+0000","last_undegraded":"2024-02-26T12:19:20.469231+0000","last_fullsized":"2024-02-26T12:19:20.469231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932590+0000","last_change":"2024-02-26T12:19:18.463188+0000","last_active":"2024-02-26T12:19:20.932590+0000","last_peered":"2024-02-26T12:19:20.932590+0000","last_clean":"2024-02-26T12:19:20.932590+0000","last_became_active":"2024-02-26T12:19:18.462775+0000","last_became_peered":"2024-02-26T12:19:18.462775+0000","last_unstale":"2024-02-26T12:19:20.932590+0000","last_undegraded":"2024-02-26T12:19:20.932590+0000","last_fullsized":"2024-02-26T12:19:20.932590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932747+0000","last_change":"2024-02-26T12:19:19.462308+0000","last_active":"2024-02-26T12:19:20.932747+0000","last_peered":"2024-02-26T12:19:20.932747+0000","last_clean":"2024-02-26T12:19:20.932747+0000","last_became_active":"2024-02-26T12:19:19.462011+0000","last_became_peered":"2024-02-26T12:19:19.462011+0000","last_unstale":"2024-02-26T12:19:20.932747+0000","last_undegraded":"2024-02-26T12:19:20.932747+0000","last_fullsized":"2024-02-26T12:19:20.932747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452209+0000","last_change":"2024-02-26T12:19:18.456487+0000","last_active":"2024-02-26T12:19:20.452209+0000","last_peered":"2024-02-26T12:19:20.452209+0000","last_clean":"2024-02-26T12:19:20.452209+0000","last_became_active":"2024-02-26T12:19:18.456207+0000","last_became_peered":"2024-02-26T12:19:18.456207+0000","last_unstale":"2024-02-26T12:19:20.452209+0000","last_undegraded":"2024-02-26T12:19:20.452209+0000","last_fullsized":"2024-02-26T12:19:20.452209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449517+0000","last_change":"2024-02-26T12:19:19.460550+0000","last_active":"2024-02-26T12:19:20.449517+0000","last_peered":"2024-02-26T12:19:20.449517+0000","last_clean":"2024-02-26T12:19:20.449517+0000","last_became_active":"2024-02-26T12:19:19.460265+0000","last_became_peered":"2024-02-26T12:19:19.460265+0000","last_unstale":"2024-02-26T12:19:20.449517+0000","last_undegraded":"2024-02-26T12:19:20.449517+0000","last_fullsized":"2024-02-26T12:19:20.449517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469567+0000","last_change":"2024-02-26T12:19:18.464033+0000","last_active":"2024-02-26T12:19:20.469567+0000","last_peered":"2024-02-26T12:19:20.469567+0000","last_clean":"2024-02-26T12:19:20.469567+0000","last_became_active":"2024-02-26T12:19:18.463599+0000","last_became_peered":"2024-02-26T12:19:18.463599+0000","last_unstale":"2024-02-26T12:19:20.469567+0000","last_undegraded":"2024-02-26T12:19:20.469567+0000","last_fullsized":"2024-02-26T12:19:20.469567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453466+0000","last_change":"2024-02-26T12:19:19.476744+0000","last_active":"2024-02-26T12:19:20.453466+0000","last_peered":"2024-02-26T12:19:20.453466+0000","last_clean":"2024-02-26T12:19:20.453466+0000","last_became_active":"2024-02-26T12:19:19.476456+0000","last_became_peered":"2024-02-26T12:19:19.476456+0000","last_unstale":"2024-02-26T12:19:20.453466+0000","last_undegraded":"2024-02-26T12:19:20.453466+0000","last_fullsized":"2024-02-26T12:19:20.453466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453526+0000","last_change":"2024-02-26T12:19:18.461181+0000","last_active":"2024-02-26T12:19:20.453526+0000","last_peered":"2024-02-26T12:19:20.453526+0000","last_clean":"2024-02-26T12:19:20.453526+0000","last_became_active":"2024-02-26T12:19:18.460919+0000","last_became_peered":"2024-02-26T12:19:18.460919+0000","last_unstale":"2024-02-26T12:19:20.453526+0000","last_undegraded":"2024-02-26T12:19:20.453526+0000","last_fullsized":"2024-02-26T12:19:20.453526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933451+0000","last_change":"2024-02-26T12:19:19.456644+0000","last_active":"2024-02-26T12:19:20.933451+0000","last_peered":"2024-02-26T12:19:20.933451+0000","last_clean":"2024-02-26T12:19:20.933451+0000","last_became_active":"2024-02-26T12:19:19.456368+0000","last_became_peered":"2024-02-26T12:19:19.456368+0000","last_unstale":"2024-02-26T12:19:20.933451+0000","last_undegraded":"2024-02-26T12:19:20.933451+0000","last_fullsized":"2024-02-26T12:19:20.933451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449625+0000","last_change":"2024-02-26T12:19:18.461795+0000","last_active":"2024-02-26T12:19:20.449625+0000","last_peered":"2024-02-26T12:19:20.449625+0000","last_clean":"2024-02-26T12:19:20.449625+0000","last_became_active":"2024-02-26T12:19:18.460734+0000","last_became_peered":"2024-02-26T12:19:18.460734+0000","last_unstale":"2024-02-26T12:19:20.449625+0000","last_undegraded":"2024-02-26T12:19:20.449625+0000","last_fullsized":"2024-02-26T12:19:20.449625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453339+0000","last_change":"2024-02-26T12:19:19.466977+0000","last_active":"2024-02-26T12:19:20.453339+0000","last_peered":"2024-02-26T12:19:20.453339+0000","last_clean":"2024-02-26T12:19:20.453339+0000","last_became_active":"2024-02-26T12:19:19.466691+0000","last_became_peered":"2024-02-26T12:19:19.466691+0000","last_unstale":"2024-02-26T12:19:20.453339+0000","last_undegraded":"2024-02-26T12:19:20.453339+0000","last_fullsized":"2024-02-26T12:19:20.453339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:36.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469361+0000","last_change":"2024-02-26T12:19:18.464762+0000","last_active":"2024-02-26T12:19:20.469361+0000","last_peered":"2024-02-26T12:19:20.469361+0000","last_clean":"2024-02-26T12:19:20.469361+0000","last_became_active":"2024-02-26T12:19:18.464498+0000","last_became_peered":"2024-02-26T12:19:18.464498+0000","last_unstale":"2024-02-26T12:19:20.469361+0000","last_undegraded":"2024-02-26T12:19:20.469361+0000","last_fullsized":"2024-02-26T12:19:20.469361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932633+0000","last_change":"2024-02-26T12:19:19.470554+0000","last_active":"2024-02-26T12:19:20.932633+0000","last_peered":"2024-02-26T12:19:20.932633+0000","last_clean":"2024-02-26T12:19:20.932633+0000","last_became_active":"2024-02-26T12:19:19.470255+0000","last_became_peered":"2024-02-26T12:19:19.470255+0000","last_unstale":"2024-02-26T12:19:20.932633+0000","last_undegraded":"2024-02-26T12:19:20.932633+0000","last_fullsized":"2024-02-26T12:19:20.932633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933472+0000","last_change":"2024-02-26T12:19:18.460695+0000","last_active":"2024-02-26T12:19:20.933472+0000","last_peered":"2024-02-26T12:19:20.933472+0000","last_clean":"2024-02-26T12:19:20.933472+0000","last_became_active":"2024-02-26T12:19:18.460421+0000","last_became_peered":"2024-02-26T12:19:18.460421+0000","last_unstale":"2024-02-26T12:19:20.933472+0000","last_undegraded":"2024-02-26T12:19:20.933472+0000","last_fullsized":"2024-02-26T12:19:20.933472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:43:36.801064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933177+0000","last_change":"2024-02-26T12:19:19.474064+0000","last_active":"2024-02-26T12:19:20.933177+0000","last_peered":"2024-02-26T12:19:20.933177+0000","last_clean":"2024-02-26T12:19:20.933177+0000","last_became_active":"2024-02-26T12:19:19.473790+0000","last_became_peered":"2024-02-26T12:19:19.473790+0000","last_unstale":"2024-02-26T12:19:20.933177+0000","last_undegraded":"2024-02-26T12:19:20.933177+0000","last_fullsized":"2024-02-26T12:19:20.933177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:25.284013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452545+0000","last_change":"2024-02-26T12:19:18.455061+0000","last_active":"2024-02-26T12:19:20.452545+0000","last_peered":"2024-02-26T12:19:20.452545+0000","last_clean":"2024-02-26T12:19:20.452545+0000","last_became_active":"2024-02-26T12:19:18.454770+0000","last_became_peered":"2024-02-26T12:19:18.454770+0000","last_unstale":"2024-02-26T12:19:20.452545+0000","last_undegraded":"2024-02-26T12:19:20.452545+0000","last_fullsized":"2024-02-26T12:19:20.452545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932700+0000","last_change":"2024-02-26T12:19:19.477159+0000","last_active":"2024-02-26T12:19:20.932700+0000","last_peered":"2024-02-26T12:19:20.932700+0000","last_clean":"2024-02-26T12:19:20.932700+0000","last_became_active":"2024-02-26T12:19:19.476899+0000","last_became_peered":"2024-02-26T12:19:19.476899+0000","last_unstale":"2024-02-26T12:19:20.932700+0000","last_undegraded":"2024-02-26T12:19:20.932700+0000","last_fullsized":"2024-02-26T12:19:20.932700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469219+0000","last_change":"2024-02-26T12:19:18.463068+0000","last_active":"2024-02-26T12:19:20.469219+0000","last_peered":"2024-02-26T12:19:20.469219+0000","last_clean":"2024-02-26T12:19:20.469219+0000","last_became_active":"2024-02-26T12:19:18.462586+0000","last_became_peered":"2024-02-26T12:19:18.462586+0000","last_unstale":"2024-02-26T12:19:20.469219+0000","last_undegraded":"2024-02-26T12:19:20.469219+0000","last_fullsized":"2024-02-26T12:19:20.469219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469287+0000","last_change":"2024-02-26T12:19:19.465821+0000","last_active":"2024-02-26T12:19:20.469287+0000","last_peered":"2024-02-26T12:19:20.469287+0000","last_clean":"2024-02-26T12:19:20.469287+0000","last_became_active":"2024-02-26T12:19:19.465294+0000","last_became_peered":"2024-02-26T12:19:19.465294+0000","last_unstale":"2024-02-26T12:19:20.469287+0000","last_undegraded":"2024-02-26T12:19:20.469287+0000","last_fullsized":"2024-02-26T12:19:20.469287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932061+0000","last_change":"2024-02-26T12:19:18.461135+0000","last_active":"2024-02-26T12:19:20.932061+0000","last_peered":"2024-02-26T12:19:20.932061+0000","last_clean":"2024-02-26T12:19:20.932061+0000","last_became_active":"2024-02-26T12:19:18.460849+0000","last_became_peered":"2024-02-26T12:19:18.460849+0000","last_unstale":"2024-02-26T12:19:20.932061+0000","last_undegraded":"2024-02-26T12:19:20.932061+0000","last_fullsized":"2024-02-26T12:19:20.932061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:55:52.430631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.473888+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.473207+0000","last_became_peered":"2024-02-26T12:19:19.473207+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453157+0000","last_change":"2024-02-26T12:19:18.461104+0000","last_active":"2024-02-26T12:19:20.453157+0000","last_peered":"2024-02-26T12:19:20.453157+0000","last_clean":"2024-02-26T12:19:20.453157+0000","last_became_active":"2024-02-26T12:19:18.460836+0000","last_became_peered":"2024-02-26T12:19:18.460836+0000","last_unstale":"2024-02-26T12:19:20.453157+0000","last_undegraded":"2024-02-26T12:19:20.453157+0000","last_fullsized":"2024-02-26T12:19:20.453157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:47:30.665043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932927+0000","last_change":"2024-02-26T12:19:19.470461+0000","last_active":"2024-02-26T12:19:20.932927+0000","last_peered":"2024-02-26T12:19:20.932927+0000","last_clean":"2024-02-26T12:19:20.932927+0000","last_became_active":"2024-02-26T12:19:19.470152+0000","last_became_peered":"2024-02-26T12:19:19.470152+0000","last_unstale":"2024-02-26T12:19:20.932927+0000","last_undegraded":"2024-02-26T12:19:20.932927+0000","last_fullsized":"2024-02-26T12:19:20.932927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932510+0000","last_change":"2024-02-26T12:19:18.455812+0000","last_active":"2024-02-26T12:19:20.932510+0000","last_peered":"2024-02-26T12:19:20.932510+0000","last_clean":"2024-02-26T12:19:20.932510+0000","last_became_active":"2024-02-26T12:19:18.455182+0000","last_became_peered":"2024-02-26T12:19:18.455182+0000","last_unstale":"2024-02-26T12:19:20.932510+0000","last_undegraded":"2024-02-26T12:19:20.932510+0000","last_fullsized":"2024-02-26T12:19:20.932510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933136+0000","last_change":"2024-02-26T12:19:19.477606+0000","last_active":"2024-02-26T12:19:20.933136+0000","last_peered":"2024-02-26T12:19:20.933136+0000","last_clean":"2024-02-26T12:19:20.933136+0000","last_became_active":"2024-02-26T12:19:19.477293+0000","last_became_peered":"2024-02-26T12:19:19.477293+0000","last_unstale":"2024-02-26T12:19:20.933136+0000","last_undegraded":"2024-02-26T12:19:20.933136+0000","last_fullsized":"2024-02-26T12:19:20.933136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:07.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449697+0000","last_change":"2024-02-26T12:19:18.461425+0000","last_active":"2024-02-26T12:19:20.449697+0000","last_peered":"2024-02-26T12:19:20.449697+0000","last_clean":"2024-02-26T12:19:20.449697+0000","last_became_active":"2024-02-26T12:19:18.461141+0000","last_became_peered":"2024-02-26T12:19:18.461141+0000","last_unstale":"2024-02-26T12:19:20.449697+0000","last_undegraded":"2024-02-26T12:19:20.449697+0000","last_fullsized":"2024-02-26T12:19:20.449697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452805+0000","last_change":"2024-02-26T12:19:19.462834+0000","last_active":"2024-02-26T12:19:20.452805+0000","last_peered":"2024-02-26T12:19:20.452805+0000","last_clean":"2024-02-26T12:19:20.452805+0000","last_became_active":"2024-02-26T12:19:19.462465+0000","last_became_peered":"2024-02-26T12:19:19.462465+0000","last_unstale":"2024-02-26T12:19:20.452805+0000","last_undegraded":"2024-02-26T12:19:20.452805+0000","last_fullsized":"2024-02-26T12:19:20.452805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932370+0000","last_change":"2024-02-26T12:19:18.456646+0000","last_active":"2024-02-26T12:19:20.932370+0000","last_peered":"2024-02-26T12:19:20.932370+0000","last_clean":"2024-02-26T12:19:20.932370+0000","last_became_active":"2024-02-26T12:19:18.456316+0000","last_became_peered":"2024-02-26T12:19:18.456316+0000","last_unstale":"2024-02-26T12:19:20.932370+0000","last_undegraded":"2024-02-26T12:19:20.932370+0000","last_fullsized":"2024-02-26T12:19:20.932370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:15:21.737677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932817+0000","last_change":"2024-02-26T12:19:19.469817+0000","last_active":"2024-02-26T12:19:20.932817+0000","last_peered":"2024-02-26T12:19:20.932817+0000","last_clean":"2024-02-26T12:19:20.932817+0000","last_became_active":"2024-02-26T12:19:19.469355+0000","last_became_peered":"2024-02-26T12:19:19.469355+0000","last_unstale":"2024-02-26T12:19:20.932817+0000","last_undegraded":"2024-02-26T12:19:20.932817+0000","last_fullsized":"2024-02-26T12:19:20.932817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932422+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:19:20.932422+0000","last_peered":"2024-02-26T12:19:20.932422+0000","last_clean":"2024-02-26T12:19:20.932422+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:19:20.932422+0000","last_undegraded":"2024-02-26T12:19:20.932422+0000","last_fullsized":"2024-02-26T12:19:20.932422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452184+0000","last_change":"2024-02-26T12:19:18.456266+0000","last_active":"2024-02-26T12:19:20.452184+0000","last_peered":"2024-02-26T12:19:20.452184+0000","last_clean":"2024-02-26T12:19:20.452184+0000","last_became_active":"2024-02-26T12:19:18.455942+0000","last_became_peered":"2024-02-26T12:19:18.455942+0000","last_unstale":"2024-02-26T12:19:20.452184+0000","last_undegraded":"2024-02-26T12:19:20.452184+0000","last_fullsized":"2024-02-26T12:19:20.452184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933368+0000","last_change":"2024-02-26T12:19:19.470887+0000","last_active":"2024-02-26T12:19:20.933368+0000","last_peered":"2024-02-26T12:19:20.933368+0000","last_clean":"2024-02-26T12:19:20.933368+0000","last_became_active":"2024-02-26T12:19:19.470607+0000","last_became_peered":"2024-02-26T12:19:19.470607+0000","last_unstale":"2024-02-26T12:19:20.933368+0000","last_undegraded":"2024-02-26T12:19:20.933368+0000","last_fullsized":"2024-02-26T12:19:20.933368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932456+0000","last_change":"2024-02-26T12:19:18.465038+0000","last_active":"2024-02-26T12:19:20.932456+0000","last_peered":"2024-02-26T12:19:20.932456+0000","last_clean":"2024-02-26T12:19:20.932456+0000","last_became_active":"2024-02-26T12:19:18.464586+0000","last_became_peered":"2024-02-26T12:19:18.464586+0000","last_unstale":"2024-02-26T12:19:20.932456+0000","last_undegraded":"2024-02-26T12:19:20.932456+0000","last_fullsized":"2024-02-26T12:19:20.932456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932968+0000","last_change":"2024-02-26T12:19:19.453339+0000","last_active":"2024-02-26T12:19:20.932968+0000","last_peered":"2024-02-26T12:19:20.932968+0000","last_clean":"2024-02-26T12:19:20.932968+0000","last_became_active":"2024-02-26T12:19:19.453031+0000","last_became_peered":"2024-02-26T12:19:19.453031+0000","last_unstale":"2024-02-26T12:19:20.932968+0000","last_undegraded":"2024-02-26T12:19:20.932968+0000","last_fullsized":"2024-02-26T12:19:20.932968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932171+0000","last_change":"2024-02-26T12:19:18.455546+0000","last_active":"2024-02-26T12:19:20.932171+0000","last_peered":"2024-02-26T12:19:20.932171+0000","last_clean":"2024-02-26T12:19:20.932171+0000","last_became_active":"2024-02-26T12:19:18.455214+0000","last_became_peered":"2024-02-26T12:19:18.455214+0000","last_unstale":"2024-02-26T12:19:20.932171+0000","last_undegraded":"2024-02-26T12:19:20.932171+0000","last_fullsized":"2024-02-26T12:19:20.932171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449348+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.449348+0000","last_peered":"2024-02-26T12:19:20.449348+0000","last_clean":"2024-02-26T12:19:20.449348+0000","last_became_active":"2024-02-26T12:19:19.458568+0000","last_became_peered":"2024-02-26T12:19:19.458568+0000","last_unstale":"2024-02-26T12:19:20.449348+0000","last_undegraded":"2024-02-26T12:19:20.449348+0000","last_fullsized":"2024-02-26T12:19:20.449348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452642+0000","last_change":"2024-02-26T12:19:18.462392+0000","last_active":"2024-02-26T12:19:20.452642+0000","last_peered":"2024-02-26T12:19:20.452642+0000","last_clean":"2024-02-26T12:19:20.452642+0000","last_became_active":"2024-02-26T12:19:18.462102+0000","last_became_peered":"2024-02-26T12:19:18.462102+0000","last_unstale":"2024-02-26T12:19:20.452642+0000","last_undegraded":"2024-02-26T12:19:20.452642+0000","last_fullsized":"2024-02-26T12:19:20.452642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453404+0000","last_change":"2024-02-26T12:19:19.457056+0000","last_active":"2024-02-26T12:19:20.453404+0000","last_peered":"2024-02-26T12:19:20.453404+0000","last_clean":"2024-02-26T12:19:20.453404+0000","last_became_active":"2024-02-26T12:19:19.456475+0000","last_became_peered":"2024-02-26T12:19:19.456475+0000","last_unstale":"2024-02-26T12:19:20.453404+0000","last_undegraded":"2024-02-26T12:19:20.453404+0000","last_fullsized":"2024-02-26T12:19:20.453404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449511+0000","last_change":"2024-02-26T12:19:18.460143+0000","last_active":"2024-02-26T12:19:20.449511+0000","last_peered":"2024-02-26T12:19:20.449511+0000","last_clean":"2024-02-26T12:19:20.449511+0000","last_became_active":"2024-02-26T12:19:18.459858+0000","last_became_peered":"2024-02-26T12:19:18.459858+0000","last_unstale":"2024-02-26T12:19:20.449511+0000","last_undegraded":"2024-02-26T12:19:20.449511+0000","last_fullsized":"2024-02-26T12:19:20.449511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453144+0000","last_change":"2024-02-26T12:19:19.462914+0000","last_active":"2024-02-26T12:19:20.453144+0000","last_peered":"2024-02-26T12:19:20.453144+0000","last_clean":"2024-02-26T12:19:20.453144+0000","last_became_active":"2024-02-26T12:19:19.462335+0000","last_became_peered":"2024-02-26T12:19:19.462335+0000","last_unstale":"2024-02-26T12:19:20.453144+0000","last_undegraded":"2024-02-26T12:19:20.453144+0000","last_fullsized":"2024-02-26T12:19:20.453144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932953+0000","last_change":"2024-02-26T12:19:18.464084+0000","last_active":"2024-02-26T12:19:20.932953+0000","last_peered":"2024-02-26T12:19:20.932953+0000","last_clean":"2024-02-26T12:19:20.932953+0000","last_became_active":"2024-02-26T12:19:18.463367+0000","last_became_peered":"2024-02-26T12:19:18.463367+0000","last_unstale":"2024-02-26T12:19:20.932953+0000","last_undegraded":"2024-02-26T12:19:20.932953+0000","last_fullsized":"2024-02-26T12:19:20.932953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449431+0000","last_change":"2024-02-26T12:19:19.461058+0000","last_active":"2024-02-26T12:19:20.449431+0000","last_peered":"2024-02-26T12:19:20.449431+0000","last_clean":"2024-02-26T12:19:20.449431+0000","last_became_active":"2024-02-26T12:19:19.460767+0000","last_became_peered":"2024-02-26T12:19:19.460767+0000","last_unstale":"2024-02-26T12:19:20.449431+0000","last_undegraded":"2024-02-26T12:19:20.449431+0000","last_fullsized":"2024-02-26T12:19:20.449431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.468823+0000","last_change":"2024-02-26T12:19:18.463879+0000","last_active":"2024-02-26T12:19:20.468823+0000","last_peered":"2024-02-26T12:19:20.468823+0000","last_clean":"2024-02-26T12:19:20.468823+0000","last_became_active":"2024-02-26T12:19:18.463588+0000","last_became_peered":"2024-02-26T12:19:18.463588+0000","last_unstale":"2024-02-26T12:19:20.468823+0000","last_undegraded":"2024-02-26T12:19:20.468823+0000","last_fullsized":"2024-02-26T12:19:20.468823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932829+0000","last_change":"2024-02-26T12:19:19.472563+0000","last_active":"2024-02-26T12:19:20.932829+0000","last_peered":"2024-02-26T12:19:20.932829+0000","last_clean":"2024-02-26T12:19:20.932829+0000","last_became_active":"2024-02-26T12:19:19.472300+0000","last_became_peered":"2024-02-26T12:19:19.472300+0000","last_unstale":"2024-02-26T12:19:20.932829+0000","last_undegraded":"2024-02-26T12:19:20.932829+0000","last_fullsized":"2024-02-26T12:19:20.932829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469619+0000","last_change":"2024-02-26T12:19:18.464144+0000","last_active":"2024-02-26T12:19:20.469619+0000","last_peered":"2024-02-26T12:19:20.469619+0000","last_clean":"2024-02-26T12:19:20.469619+0000","last_became_active":"2024-02-26T12:19:18.462912+0000","last_became_peered":"2024-02-26T12:19:18.462912+0000","last_unstale":"2024-02-26T12:19:20.469619+0000","last_undegraded":"2024-02-26T12:19:20.469619+0000","last_fullsized":"2024-02-26T12:19:20.469619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933409+0000","last_change":"2024-02-26T12:19:19.462865+0000","last_active":"2024-02-26T12:19:20.933409+0000","last_peered":"2024-02-26T12:19:20.933409+0000","last_clean":"2024-02-26T12:19:20.933409+0000","last_became_active":"2024-02-26T12:19:19.460986+0000","last_became_peered":"2024-02-26T12:19:19.460986+0000","last_unstale":"2024-02-26T12:19:20.933409+0000","last_undegraded":"2024-02-26T12:19:20.933409+0000","last_fullsized":"2024-02-26T12:19:20.933409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932323+0000","last_change":"2024-02-26T12:19:18.461638+0000","last_active":"2024-02-26T12:19:20.932323+0000","last_peered":"2024-02-26T12:19:20.932323+0000","last_clean":"2024-02-26T12:19:20.932323+0000","last_became_active":"2024-02-26T12:19:18.461352+0000","last_became_peered":"2024-02-26T12:19:18.461352+0000","last_unstale":"2024-02-26T12:19:20.932323+0000","last_undegraded":"2024-02-26T12:19:20.932323+0000","last_fullsized":"2024-02-26T12:19:20.932323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453133+0000","last_change":"2024-02-26T12:19:19.455737+0000","last_active":"2024-02-26T12:19:20.453133+0000","last_peered":"2024-02-26T12:19:20.453133+0000","last_clean":"2024-02-26T12:19:20.453133+0000","last_became_active":"2024-02-26T12:19:19.454845+0000","last_became_peered":"2024-02-26T12:19:19.454845+0000","last_unstale":"2024-02-26T12:19:20.453133+0000","last_undegraded":"2024-02-26T12:19:20.453133+0000","last_fullsized":"2024-02-26T12:19:20.453133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:08.196993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449440+0000","last_change":"2024-02-26T12:19:18.462514+0000","last_active":"2024-02-26T12:19:20.449440+0000","last_peered":"2024-02-26T12:19:20.449440+0000","last_clean":"2024-02-26T12:19:20.449440+0000","last_became_active":"2024-02-26T12:19:18.461749+0000","last_became_peered":"2024-02-26T12:19:18.461749+0000","last_unstale":"2024-02-26T12:19:20.449440+0000","last_undegraded":"2024-02-26T12:19:20.449440+0000","last_fullsized":"2024-02-26T12:19:20.449440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932875+0000","last_change":"2024-02-26T12:19:19.461344+0000","last_active":"2024-02-26T12:19:20.932875+0000","last_peered":"2024-02-26T12:19:20.932875+0000","last_clean":"2024-02-26T12:19:20.932875+0000","last_became_active":"2024-02-26T12:19:19.461069+0000","last_became_peered":"2024-02-26T12:19:19.461069+0000","last_unstale":"2024-02-26T12:19:20.932875+0000","last_undegraded":"2024-02-26T12:19:20.932875+0000","last_fullsized":"2024-02-26T12:19:20.932875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449411+0000","last_change":"2024-02-26T12:19:18.459629+0000","last_active":"2024-02-26T12:19:20.449411+0000","last_peered":"2024-02-26T12:19:20.449411+0000","last_clean":"2024-02-26T12:19:20.449411+0000","last_became_active":"2024-02-26T12:19:18.459350+0000","last_became_peered":"2024-02-26T12:19:18.459350+0000","last_unstale":"2024-02-26T12:19:20.449411+0000","last_undegraded":"2024-02-26T12:19:20.449411+0000","last_fullsized":"2024-02-26T12:19:20.449411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932758+0000","last_change":"2024-02-26T12:19:19.460693+0000","last_active":"2024-02-26T12:19:20.932758+0000","last_peered":"2024-02-26T12:19:20.932758+0000","last_clean":"2024-02-26T12:19:20.932758+0000","last_became_active":"2024-02-26T12:19:19.459680+0000","last_became_peered":"2024-02-26T12:19:19.459680+0000","last_unstale":"2024-02-26T12:19:20.932758+0000","last_undegraded":"2024-02-26T12:19:20.932758+0000","last_fullsized":"2024-02-26T12:19:20.932758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932791+0000","last_change":"2024-02-26T12:19:18.461202+0000","last_active":"2024-02-26T12:19:20.932791+0000","last_peered":"2024-02-26T12:19:20.932791+0000","last_clean":"2024-02-26T12:19:20.932791+0000","last_became_active":"2024-02-26T12:19:18.460874+0000","last_became_peered":"2024-02-26T12:19:18.460874+0000","last_unstale":"2024-02-26T12:19:20.932791+0000","last_undegraded":"2024-02-26T12:19:20.932791+0000","last_fullsized":"2024-02-26T12:19:20.932791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:16.993521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469337+0000","last_change":"2024-02-26T12:19:19.465226+0000","last_active":"2024-02-26T12:19:20.469337+0000","last_peered":"2024-02-26T12:19:20.469337+0000","last_clean":"2024-02-26T12:19:20.469337+0000","last_became_active":"2024-02-26T12:19:19.464959+0000","last_became_peered":"2024-02-26T12:19:19.464959+0000","last_unstale":"2024-02-26T12:19:20.469337+0000","last_undegraded":"2024-02-26T12:19:20.469337+0000","last_fullsized":"2024-02-26T12:19:20.469337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452990+0000","last_change":"2024-02-26T12:19:19.458902+0000","last_active":"2024-02-26T12:19:20.452990+0000","last_peered":"2024-02-26T12:19:20.452990+0000","last_clean":"2024-02-26T12:19:20.452990+0000","last_became_active":"2024-02-26T12:19:19.458618+0000","last_became_peered":"2024-02-26T12:19:19.458618+0000","last_unstale":"2024-02-26T12:19:20.452990+0000","last_undegraded":"2024-02-26T12:19:20.452990+0000","last_fullsized":"2024-02-26T12:19:20.452990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932599+0000","last_change":"2024-02-26T12:19:18.461020+0000","last_active":"2024-02-26T12:19:20.932599+0000","last_peered":"2024-02-26T12:19:20.932599+0000","last_clean":"2024-02-26T12:19:20.932599+0000","last_became_active":"2024-02-26T12:19:18.460670+0000","last_became_peered":"2024-02-26T12:19:18.460670+0000","last_unstale":"2024-02-26T12:19:20.932599+0000","last_undegraded":"2024-02-26T12:19:20.932599+0000","last_fullsized":"2024-02-26T12:19:20.932599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452392+0000","last_change":"2024-02-26T12:19:19.458148+0000","last_active":"2024-02-26T12:19:20.452392+0000","last_peered":"2024-02-26T12:19:20.452392+0000","last_clean":"2024-02-26T12:19:20.452392+0000","last_became_active":"2024-02-26T12:19:19.457530+0000","last_became_peered":"2024-02-26T12:19:19.457530+0000","last_unstale":"2024-02-26T12:19:20.452392+0000","last_undegraded":"2024-02-26T12:19:20.452392+0000","last_fullsized":"2024-02-26T12:19:20.452392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932807+0000","last_change":"2024-02-26T12:19:18.465248+0000","last_active":"2024-02-26T12:19:20.932807+0000","last_peered":"2024-02-26T12:19:20.932807+0000","last_clean":"2024-02-26T12:19:20.932807+0000","last_became_active":"2024-02-26T12:19:18.464973+0000","last_became_peered":"2024-02-26T12:19:18.464973+0000","last_unstale":"2024-02-26T12:19:20.932807+0000","last_undegraded":"2024-02-26T12:19:20.932807+0000","last_fullsized":"2024-02-26T12:19:20.932807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933345+0000","last_change":"2024-02-26T12:19:19.463869+0000","last_active":"2024-02-26T12:19:20.933345+0000","last_peered":"2024-02-26T12:19:20.933345+0000","last_clean":"2024-02-26T12:19:20.933345+0000","last_became_active":"2024-02-26T12:19:19.463540+0000","last_became_peered":"2024-02-26T12:19:19.463540+0000","last_unstale":"2024-02-26T12:19:20.933345+0000","last_undegraded":"2024-02-26T12:19:20.933345+0000","last_fullsized":"2024-02-26T12:19:20.933345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932626+0000","last_change":"2024-02-26T12:19:18.459968+0000","last_active":"2024-02-26T12:19:20.932626+0000","last_peered":"2024-02-26T12:19:20.932626+0000","last_clean":"2024-02-26T12:19:20.932626+0000","last_became_active":"2024-02-26T12:19:18.459646+0000","last_became_peered":"2024-02-26T12:19:18.459646+0000","last_unstale":"2024-02-26T12:19:20.932626+0000","last_undegraded":"2024-02-26T12:19:20.932626+0000","last_fullsized":"2024-02-26T12:19:20.932626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932466+0000","last_change":"2024-02-26T12:19:19.468378+0000","last_active":"2024-02-26T12:19:20.932466+0000","last_peered":"2024-02-26T12:19:20.932466+0000","last_clean":"2024-02-26T12:19:20.932466+0000","last_became_active":"2024-02-26T12:19:19.467864+0000","last_became_peered":"2024-02-26T12:19:19.467864+0000","last_unstale":"2024-02-26T12:19:20.932466+0000","last_undegraded":"2024-02-26T12:19:20.932466+0000","last_fullsized":"2024-02-26T12:19:20.932466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933450+0000","last_change":"2024-02-26T12:19:18.463225+0000","last_active":"2024-02-26T12:19:20.933450+0000","last_peered":"2024-02-26T12:19:20.933450+0000","last_clean":"2024-02-26T12:19:20.933450+0000","last_became_active":"2024-02-26T12:19:18.462195+0000","last_became_peered":"2024-02-26T12:19:18.462195+0000","last_unstale":"2024-02-26T12:19:20.933450+0000","last_undegraded":"2024-02-26T12:19:20.933450+0000","last_fullsized":"2024-02-26T12:19:20.933450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:08:24.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:19:23.392 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:19:23.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.544+0000 7fdb2ac36640 1 Processor -- start 2024-02-26T12:19:23.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.544+0000 7fdb2ac36640 1 -- start start 2024-02-26T12:19:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb2ac36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb240b1c30 0x7fdb240b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb2ac36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb240cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb2ac36640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2406b800 con 0x7fdb2415f1c0 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb2ac36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240c4110 con 0x7fdb240b1c30 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb2ac36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240b1260 con 0x7fdb240b0df0 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb289d2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdb2415f1c0 0x7fdb240b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57940/0 (socket says 172.21.15.113:57940) 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb289d2640 1 -- 172.21.15.113:0/1743675010 learned_addr learned my addr 172.21.15.113:0/1743675010 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534369526 0 0) 0x7fdb2406b800 con 0x7fdb2415f1c0 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb14003520 con 0x7fdb2415f1c0 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb23fff640 1 --2- 172.21.15.113:0/1743675010 >> v2:172.21.15.152:3300/0 conn(0x7fdb240b1c30 0x7fdb240b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb291d3640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb240cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4027627174 0 0) 0x7fdb14003520 con 0x7fdb2415f1c0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 msgr2=0x7fdb240cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb240cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 >> v2:172.21.15.152:3300/0 conn(0x7fdb240b1c30 msgr2=0x7fdb240b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 --2- 172.21.15.113:0/1743675010 >> v2:172.21.15.152:3300/0 conn(0x7fdb240b1c30 0x7fdb240b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2406abf0 con 0x7fdb2415f1c0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fdb18001690 con 0x7fdb2415f1c0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 >> v1:172.21.15.113:6789/0 conn(0x7fdb2415f1c0 legacy=0x7fdb240b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb140039b0 0x7fdb14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240c4110 con 0x7fdb14004d40 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240b1260 con 0x7fdb140039b0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1400b9c0 con 0x7fdb240b0df0 2024-02-26T12:19:23.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb291d3640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.545+0000 7fdb289d2640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb140039b0 0x7fdb14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb23fff640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 -- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 msgr2=0x7fdb14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb240b0df0 0x7fdb14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 -- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb140039b0 msgr2=0x7fdb14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb140039b0 0x7fdb14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 -- 172.21.15.113:0/1743675010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14003520 con 0x7fdb14004d40 2024-02-26T12:19:23.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb291d3640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb140051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009fc0 tx=0x7fdb14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26addade2573490 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.546+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c039070 con 0x7fdb14004d40 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c02cc20 con 0x7fdb14004d40 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb237fe640 1 -- 172.21.15.113:0/1743675010 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c009c10 con 0x7fdb14004d40 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 -- 172.21.15.113:0/1743675010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 msgr2=0x7fdb140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/1743675010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb140051c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009fc0 tx=0x7fdb14005830 comp rx=0 tx=0).stop 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb291d3640 1 -- 172.21.15.113:0/1743675010 reap_dead start 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 -- 172.21.15.113:0/1743675010 shutdown_connections 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 -- 172.21.15.113:0/1743675010 >> 172.21.15.113:0/1743675010 conn(0x7fdb240d0760 msgr2=0x7fdb240d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 -- 172.21.15.113:0/1743675010 shutdown_connections 2024-02-26T12:19:23.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.547+0000 7fdb2ac36640 1 -- 172.21.15.113:0/1743675010 wait complete. 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.548+0000 7fdb2ac36640 1 Processor -- start 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.548+0000 7fdb2ac36640 1 -- start start 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb2414d2e0 0x7fdb2414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb241f5460 0x7fdb241f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2406b490 con 0x7fdb14004d40 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2406b1b0 con 0x7fdb241f5460 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb2ac36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240cc780 con 0x7fdb2414d2e0 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb289d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb289d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38204/0 (socket says 172.21.15.113:38204) 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb289d2640 1 -- 172.21.15.113:0/3007331710 learned_addr learned my addr 172.21.15.113:0/3007331710 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb291d3640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb241f5460 0x7fdb241f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.549+0000 7fdb23fff640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb2414d2e0 0x7fdb2414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 -- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb2414d2e0 msgr2=0x7fdb2414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb2414d2e0 0x7fdb2414d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 -- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb241f5460 msgr2=0x7fdb241f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb241f5460 0x7fdb241f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 -- 172.21.15.113:0/3007331710 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb241e5360 con 0x7fdb14004d40 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb289d2640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb180072f0 tx=0x7fdb180076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800f960 con 0x7fdb14004d40 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb18018070 con 0x7fdb14004d40 2024-02-26T12:19:23.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb241e5600 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800fd40 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.550+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb240b3cb0 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.551+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb24074a50 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.551+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb1801d460 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.552+0000 7fdb217fa640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 0x7fdb0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.552+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb1808a320 con 0x7fdb14004d40 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.552+0000 7fdb23fff640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 0x7fdb0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.552+0000 7fdb23fff640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 0x7fdb0806d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c7150 tx=0x7fdb10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.556+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb180591a0 con 0x7fdb14004d40 2024-02-26T12:19:23.687 INFO:tasks.ceph.mds.d.smithi152.stderr:2024-02-26T12:19:23.701+0000 7f5a8bff1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-26T12:19:23.708 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.723+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb2414dca0 con 0x7fdb0806b4d0 2024-02-26T12:19:23.714 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.729+0000 7fdb217fa640 1 -- 172.21.15.113:0/3007331710 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251946 (secure 0 0 0) 0x7fdb2414dca0 con 0x7fdb0806b4d0 2024-02-26T12:19:23.718 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:23.720 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:19:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.731+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 msgr2=0x7fdb0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.731+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 0x7fdb0806d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c7150 tx=0x7fdb10008040 comp rx=0 tx=0).stop 2024-02-26T12:19:23.722 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.731+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 msgr2=0x7fdb240b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.731+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdb180072f0 tx=0x7fdb180076f0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 shutdown_connections 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdb0806b4d0 0x7fdb0806d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb241f5460 0x7fdb241f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb2414d2e0 0x7fdb2414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 --2- 172.21.15.113:0/3007331710 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb14004d40 0x7fdb240b61d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 >> 172.21.15.113:0/3007331710 conn(0x7fdb240d0760 msgr2=0x7fdb240c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 shutdown_connections 2024-02-26T12:19:23.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.732+0000 7fdb2ac36640 1 -- 172.21.15.113:0/3007331710 wait complete. 2024-02-26T12:19:23.728 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-02-26T12:19:23.156187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218908,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755812,"statfs":{"total":773094113280,"available":772869951488,"internally_reserved":0,"allocated":2805760,"data_stored":1708928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.717484"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933043+0000","last_change":"2024-02-26T12:19:19.469679+0000","last_active":"2024-02-26T12:19:20.933043+0000","last_peered":"2024-02-26T12:19:20.933043+0000","last_clean":"2024-02-26T12:19:20.933043+0000","last_became_active":"2024-02-26T12:19:19.469330+0000","last_became_peered":"2024-02-26T12:19:19.469330+0000","last_unstale":"2024-02-26T12:19:20.933043+0000","last_undegraded":"2024-02-26T12:19:20.933043+0000","last_fullsized":"2024-02-26T12:19:20.933043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449495+0000","last_change":"2024-02-26T12:19:19.464902+0000","last_active":"2024-02-26T12:19:20.449495+0000","last_peered":"2024-02-26T12:19:20.449495+0000","last_clean":"2024-02-26T12:19:20.449495+0000","last_became_active":"2024-02-26T12:19:19.464146+0000","last_became_peered":"2024-02-26T12:19:19.464146+0000","last_unstale":"2024-02-26T12:19:20.449495+0000","last_undegraded":"2024-02-26T12:19:20.449495+0000","last_fullsized":"2024-02-26T12:19:20.449495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933290+0000","last_change":"2024-02-26T12:19:19.455501+0000","last_active":"2024-02-26T12:19:20.933290+0000","last_peered":"2024-02-26T12:19:20.933290+0000","last_clean":"2024-02-26T12:19:20.933290+0000","last_became_active":"2024-02-26T12:19:19.455220+0000","last_became_peered":"2024-02-26T12:19:19.455220+0000","last_unstale":"2024-02-26T12:19:20.933290+0000","last_undegraded":"2024-02-26T12:19:20.933290+0000","last_fullsized":"2024-02-26T12:19:20.933290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:18.000356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452612+0000","last_change":"2024-02-26T12:19:19.463628+0000","last_active":"2024-02-26T12:19:20.452612+0000","last_peered":"2024-02-26T12:19:20.452612+0000","last_clean":"2024-02-26T12:19:20.452612+0000","last_became_active":"2024-02-26T12:19:19.463142+0000","last_became_peered":"2024-02-26T12:19:19.463142+0000","last_unstale":"2024-02-26T12:19:20.452612+0000","last_undegraded":"2024-02-26T12:19:20.452612+0000","last_fullsized":"2024-02-26T12:19:20.452612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932648+0000","last_change":"2024-02-26T12:19:19.474833+0000","last_active":"2024-02-26T12:19:20.932648+0000","last_peered":"2024-02-26T12:19:20.932648+0000","last_clean":"2024-02-26T12:19:20.932648+0000","last_became_active":"2024-02-26T12:19:19.474460+0000","last_became_peered":"2024-02-26T12:19:19.474460+0000","last_unstale":"2024-02-26T12:19:20.932648+0000","last_undegraded":"2024-02-26T12:19:20.932648+0000","last_fullsized":"2024-02-26T12:19:20.932648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452346+0000","last_change":"2024-02-26T12:19:19.465004+0000","last_active":"2024-02-26T12:19:20.452346+0000","last_peered":"2024-02-26T12:19:20.452346+0000","last_clean":"2024-02-26T12:19:20.452346+0000","last_became_active":"2024-02-26T12:19:19.464746+0000","last_became_peered":"2024-02-26T12:19:19.464746+0000","last_unstale":"2024-02-26T12:19:20.452346+0000","last_undegraded":"2024-02-26T12:19:20.452346+0000","last_fullsized":"2024-02-26T12:19:20.452346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932594+0000","last_change":"2024-02-26T12:19:19.472236+0000","last_active":"2024-02-26T12:19:20.932594+0000","last_peered":"2024-02-26T12:19:20.932594+0000","last_clean":"2024-02-26T12:19:20.932594+0000","last_became_active":"2024-02-26T12:19:19.471857+0000","last_became_peered":"2024-02-26T12:19:19.471857+0000","last_unstale":"2024-02-26T12:19:20.932594+0000","last_undegraded":"2024-02-26T12:19:20.932594+0000","last_fullsized":"2024-02-26T12:19:20.932594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932555+0000","last_change":"2024-02-26T12:19:19.471776+0000","last_active":"2024-02-26T12:19:20.932555+0000","last_peered":"2024-02-26T12:19:20.932555+0000","last_clean":"2024-02-26T12:19:20.932555+0000","last_became_active":"2024-02-26T12:19:19.471502+0000","last_became_peered":"2024-02-26T12:19:19.471502+0000","last_unstale":"2024-02-26T12:19:20.932555+0000","last_undegraded":"2024-02-26T12:19:20.932555+0000","last_fullsized":"2024-02-26T12:19:20.932555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933050+0000","last_change":"2024-02-26T12:19:19.477637+0000","last_active":"2024-02-26T12:19:20.933050+0000","last_peered":"2024-02-26T12:19:20.933050+0000","last_clean":"2024-02-26T12:19:20.933050+0000","last_became_active":"2024-02-26T12:19:19.476957+0000","last_became_peered":"2024-02-26T12:19:19.476957+0000","last_unstale":"2024-02-26T12:19:20.933050+0000","last_undegraded":"2024-02-26T12:19:20.933050+0000","last_fullsized":"2024-02-26T12:19:20.933050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:09:58.291307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469618+0000","last_change":"2024-02-26T12:19:19.463237+0000","last_active":"2024-02-26T12:19:20.469618+0000","last_peered":"2024-02-26T12:19:20.469618+0000","last_clean":"2024-02-26T12:19:20.469618+0000","last_became_active":"2024-02-26T12:19:19.462923+0000","last_became_peered":"2024-02-26T12:19:19.462923+0000","last_unstale":"2024-02-26T12:19:20.469618+0000","last_undegraded":"2024-02-26T12:19:20.469618+0000","last_fullsized":"2024-02-26T12:19:20.469618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469534+0000","last_change":"2024-02-26T12:19:19.469387+0000","last_active":"2024-02-26T12:19:20.469534+0000","last_peered":"2024-02-26T12:19:20.469534+0000","last_clean":"2024-02-26T12:19:20.469534+0000","last_became_active":"2024-02-26T12:19:19.469106+0000","last_became_peered":"2024-02-26T12:19:19.469106+0000","last_unstale":"2024-02-26T12:19:20.469534+0000","last_undegraded":"2024-02-26T12:19:20.469534+0000","last_fullsized":"2024-02-26T12:19:20.469534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453265+0000","last_change":"2024-02-26T12:19:19.462424+0000","last_active":"2024-02-26T12:19:20.453265+0000","last_peered":"2024-02-26T12:19:20.453265+0000","last_clean":"2024-02-26T12:19:20.453265+0000","last_became_active":"2024-02-26T12:19:19.462155+0000","last_became_peered":"2024-02-26T12:19:19.462155+0000","last_unstale":"2024-02-26T12:19:20.453265+0000","last_undegraded":"2024-02-26T12:19:20.453265+0000","last_fullsized":"2024-02-26T12:19:20.453265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932944+0000","last_change":"2024-02-26T12:19:19.468734+0000","last_active":"2024-02-26T12:19:20.932944+0000","last_peered":"2024-02-26T12:19:20.932944+0000","last_clean":"2024-02-26T12:19:20.932944+0000","last_became_active":"2024-02-26T12:19:19.468362+0000","last_became_peered":"2024-02-26T12:19:19.468362+0000","last_unstale":"2024-02-26T12:19:20.932944+0000","last_undegraded":"2024-02-26T12:19:20.932944+0000","last_fullsized":"2024-02-26T12:19:20.932944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933218+0000","last_change":"2024-02-26T12:19:19.458457+0000","last_active":"2024-02-26T12:19:20.933218+0000","last_peered":"2024-02-26T12:19:20.933218+0000","last_clean":"2024-02-26T12:19:20.933218+0000","last_became_active":"2024-02-26T12:19:19.458167+0000","last_became_peered":"2024-02-26T12:19:19.458167+0000","last_unstale":"2024-02-26T12:19:20.933218+0000","last_undegraded":"2024-02-26T12:19:20.933218+0000","last_fullsized":"2024-02-26T12:19:20.933218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:34:16.814402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449347+0000","last_change":"2024-02-26T12:19:19.457554+0000","last_active":"2024-02-26T12:19:20.449347+0000","last_peered":"2024-02-26T12:19:20.449347+0000","last_clean":"2024-02-26T12:19:20.449347+0000","last_became_active":"2024-02-26T12:19:19.457255+0000","last_became_peered":"2024-02-26T12:19:19.457255+0000","last_unstale":"2024-02-26T12:19:20.449347+0000","last_undegraded":"2024-02-26T12:19:20.449347+0000","last_fullsized":"2024-02-26T12:19:20.449347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452064+0000","last_change":"2024-02-26T12:19:19.454291+0000","last_active":"2024-02-26T12:19:20.452064+0000","last_peered":"2024-02-26T12:19:20.452064+0000","last_clean":"2024-02-26T12:19:20.452064+0000","last_became_active":"2024-02-26T12:19:19.454008+0000","last_became_peered":"2024-02-26T12:19:19.454008+0000","last_unstale":"2024-02-26T12:19:20.452064+0000","last_undegraded":"2024-02-26T12:19:20.452064+0000","last_fullsized":"2024-02-26T12:19:20.452064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453519+0000","last_change":"2024-02-26T12:19:19.470053+0000","last_active":"2024-02-26T12:19:20.453519+0000","last_peered":"2024-02-26T12:19:20.453519+0000","last_clean":"2024-02-26T12:19:20.453519+0000","last_became_active":"2024-02-26T12:19:19.469775+0000","last_became_peered":"2024-02-26T12:19:19.469775+0000","last_unstale":"2024-02-26T12:19:20.453519+0000","last_undegraded":"2024-02-26T12:19:20.453519+0000","last_fullsized":"2024-02-26T12:19:20.453519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932459+0000","last_change":"2024-02-26T12:19:19.467381+0000","last_active":"2024-02-26T12:19:20.932459+0000","last_peered":"2024-02-26T12:19:20.932459+0000","last_clean":"2024-02-26T12:19:20.932459+0000","last_became_active":"2024-02-26T12:19:19.467003+0000","last_became_peered":"2024-02-26T12:19:19.467003+0000","last_unstale":"2024-02-26T12:19:20.932459+0000","last_undegraded":"2024-02-26T12:19:20.932459+0000","last_fullsized":"2024-02-26T12:19:20.932459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932943+0000","last_change":"2024-02-26T12:19:19.472512+0000","last_active":"2024-02-26T12:19:20.932943+0000","last_peered":"2024-02-26T12:19:20.932943+0000","last_clean":"2024-02-26T12:19:20.932943+0000","last_became_active":"2024-02-26T12:19:19.472179+0000","last_became_peered":"2024-02-26T12:19:19.472179+0000","last_unstale":"2024-02-26T12:19:20.932943+0000","last_undegraded":"2024-02-26T12:19:20.932943+0000","last_fullsized":"2024-02-26T12:19:20.932943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469423+0000","last_change":"2024-02-26T12:19:19.458929+0000","last_active":"2024-02-26T12:19:20.469423+0000","last_peered":"2024-02-26T12:19:20.469423+0000","last_clean":"2024-02-26T12:19:20.469423+0000","last_became_active":"2024-02-26T12:19:19.458670+0000","last_became_peered":"2024-02-26T12:19:19.458670+0000","last_unstale":"2024-02-26T12:19:20.469423+0000","last_undegraded":"2024-02-26T12:19:20.469423+0000","last_fullsized":"2024-02-26T12:19:20.469423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933262+0000","last_change":"2024-02-26T12:19:19.474768+0000","last_active":"2024-02-26T12:19:20.933262+0000","last_peered":"2024-02-26T12:19:20.933262+0000","last_clean":"2024-02-26T12:19:20.933262+0000","last_became_active":"2024-02-26T12:19:19.474509+0000","last_became_peered":"2024-02-26T12:19:19.474509+0000","last_unstale":"2024-02-26T12:19:20.933262+0000","last_undegraded":"2024-02-26T12:19:20.933262+0000","last_fullsized":"2024-02-26T12:19:20.933262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:18:43.353358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452428+0000","last_change":"2024-02-26T12:19:19.469403+0000","last_active":"2024-02-26T12:19:20.452428+0000","last_peered":"2024-02-26T12:19:20.452428+0000","last_clean":"2024-02-26T12:19:20.452428+0000","last_became_active":"2024-02-26T12:19:19.469137+0000","last_became_peered":"2024-02-26T12:19:19.469137+0000","last_unstale":"2024-02-26T12:19:20.452428+0000","last_undegraded":"2024-02-26T12:19:20.452428+0000","last_fullsized":"2024-02-26T12:19:20.452428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932447+0000","last_change":"2024-02-26T12:19:19.459664+0000","last_active":"2024-02-26T12:19:20.932447+0000","last_peered":"2024-02-26T12:19:20.932447+0000","last_clean":"2024-02-26T12:19:20.932447+0000","last_became_active":"2024-02-26T12:19:19.459409+0000","last_became_peered":"2024-02-26T12:19:19.459409+0000","last_unstale":"2024-02-26T12:19:20.932447+0000","last_undegraded":"2024-02-26T12:19:20.932447+0000","last_fullsized":"2024-02-26T12:19:20.932447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452126+0000","last_change":"2024-02-26T12:19:19.465721+0000","last_active":"2024-02-26T12:19:20.452126+0000","last_peered":"2024-02-26T12:19:20.452126+0000","last_clean":"2024-02-26T12:19:20.452126+0000","last_became_active":"2024-02-26T12:19:19.465390+0000","last_became_peered":"2024-02-26T12:19:19.465390+0000","last_unstale":"2024-02-26T12:19:20.452126+0000","last_undegraded":"2024-02-26T12:19:20.452126+0000","last_fullsized":"2024-02-26T12:19:20.452126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932702+0000","last_change":"2024-02-26T12:19:19.461546+0000","last_active":"2024-02-26T12:19:20.932702+0000","last_peered":"2024-02-26T12:19:20.932702+0000","last_clean":"2024-02-26T12:19:20.932702+0000","last_became_active":"2024-02-26T12:19:19.461235+0000","last_became_peered":"2024-02-26T12:19:19.461235+0000","last_unstale":"2024-02-26T12:19:20.932702+0000","last_undegraded":"2024-02-26T12:19:20.932702+0000","last_fullsized":"2024-02-26T12:19:20.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469664+0000","last_change":"2024-02-26T12:19:19.470118+0000","last_active":"2024-02-26T12:19:20.469664+0000","last_peered":"2024-02-26T12:19:20.469664+0000","last_clean":"2024-02-26T12:19:20.469664+0000","last_became_active":"2024-02-26T12:19:19.469859+0000","last_became_peered":"2024-02-26T12:19:19.469859+0000","last_unstale":"2024-02-26T12:19:20.469664+0000","last_undegraded":"2024-02-26T12:19:20.469664+0000","last_fullsized":"2024-02-26T12:19:20.469664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449593+0000","last_change":"2024-02-26T12:19:19.461901+0000","last_active":"2024-02-26T12:19:20.449593+0000","last_peered":"2024-02-26T12:19:20.449593+0000","last_clean":"2024-02-26T12:19:20.449593+0000","last_became_active":"2024-02-26T12:19:19.461611+0000","last_became_peered":"2024-02-26T12:19:19.461611+0000","last_unstale":"2024-02-26T12:19:20.449593+0000","last_undegraded":"2024-02-26T12:19:20.449593+0000","last_fullsized":"2024-02-26T12:19:20.449593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.466246+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.465853+0000","last_became_peered":"2024-02-26T12:19:19.465853+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933418+0000","last_change":"2024-02-26T12:19:19.462596+0000","last_active":"2024-02-26T12:19:20.933418+0000","last_peered":"2024-02-26T12:19:20.933418+0000","last_clean":"2024-02-26T12:19:20.933418+0000","last_became_active":"2024-02-26T12:19:19.462151+0000","last_became_peered":"2024-02-26T12:19:19.462151+0000","last_unstale":"2024-02-26T12:19:20.933418+0000","last_undegraded":"2024-02-26T12:19:20.933418+0000","last_fullsized":"2024-02-26T12:19:20.933418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452517+0000","last_change":"2024-02-26T12:19:19.463840+0000","last_active":"2024-02-26T12:19:20.452517+0000","last_peered":"2024-02-26T12:19:20.452517+0000","last_clean":"2024-02-26T12:19:20.452517+0000","last_became_active":"2024-02-26T12:19:19.462936+0000","last_became_peered":"2024-02-26T12:19:19.462936+0000","last_unstale":"2024-02-26T12:19:20.452517+0000","last_undegraded":"2024-02-26T12:19:20.452517+0000","last_fullsized":"2024-02-26T12:19:20.452517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932299+0000","last_change":"2024-02-26T12:19:19.463407+0000","last_active":"2024-02-26T12:19:20.932299+0000","last_peered":"2024-02-26T12:19:20.932299+0000","last_clean":"2024-02-26T12:19:20.932299+0000","last_became_active":"2024-02-26T12:19:19.463126+0000","last_became_peered":"2024-02-26T12:19:19.463126+0000","last_unstale":"2024-02-26T12:19:20.932299+0000","last_undegraded":"2024-02-26T12:19:20.932299+0000","last_fullsized":"2024-02-26T12:19:20.932299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469300+0000","last_change":"2024-02-26T12:19:19.466527+0000","last_active":"2024-02-26T12:19:20.469300+0000","last_peered":"2024-02-26T12:19:20.469300+0000","last_clean":"2024-02-26T12:19:20.469300+0000","last_became_active":"2024-02-26T12:19:19.466230+0000","last_became_peered":"2024-02-26T12:19:19.466230+0000","last_unstale":"2024-02-26T12:19:20.469300+0000","last_undegraded":"2024-02-26T12:19:20.469300+0000","last_fullsized":"2024-02-26T12:19:20.469300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453228+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.453228+0000","last_peered":"2024-02-26T12:19:20.453228+0000","last_clean":"2024-02-26T12:19:20.453228+0000","last_became_active":"2024-02-26T12:19:19.458585+0000","last_became_peered":"2024-02-26T12:19:19.458585+0000","last_unstale":"2024-02-26T12:19:20.453228+0000","last_undegraded":"2024-02-26T12:19:20.453228+0000","last_fullsized":"2024-02-26T12:19:20.453228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932859+0000","last_change":"2024-02-26T12:19:18.462238+0000","last_active":"2024-02-26T12:19:20.932859+0000","last_peered":"2024-02-26T12:19:20.932859+0000","last_clean":"2024-02-26T12:19:20.932859+0000","last_became_active":"2024-02-26T12:19:18.461454+0000","last_became_peered":"2024-02-26T12:19:18.461454+0000","last_unstale":"2024-02-26T12:19:20.932859+0000","last_undegraded":"2024-02-26T12:19:20.932859+0000","last_fullsized":"2024-02-26T12:19:20.932859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933404+0000","last_change":"2024-02-26T12:19:19.454565+0000","last_active":"2024-02-26T12:19:20.933404+0000","last_peered":"2024-02-26T12:19:20.933404+0000","last_clean":"2024-02-26T12:19:20.933404+0000","last_became_active":"2024-02-26T12:19:19.454147+0000","last_became_peered":"2024-02-26T12:19:19.454147+0000","last_unstale":"2024-02-26T12:19:20.933404+0000","last_undegraded":"2024-02-26T12:19:20.933404+0000","last_fullsized":"2024-02-26T12:19:20.933404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469231+0000","last_change":"2024-02-26T12:19:18.462539+0000","last_active":"2024-02-26T12:19:20.469231+0000","last_peered":"2024-02-26T12:19:20.469231+0000","last_clean":"2024-02-26T12:19:20.469231+0000","last_became_active":"2024-02-26T12:19:18.462256+0000","last_became_peered":"2024-02-26T12:19:18.462256+0000","last_unstale":"2024-02-26T12:19:20.469231+0000","last_undegraded":"2024-02-26T12:19:20.469231+0000","last_fullsized":"2024-02-26T12:19:20.469231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932590+0000","last_change":"2024-02-26T12:19:18.463188+0000","last_active":"2024-02-26T12:19:20.932590+0000","last_peered":"2024-02-26T12:19:20.932590+0000","last_clean":"2024-02-26T12:19:20.932590+0000","last_became_active":"2024-02-26T12:19:18.462775+0000","last_became_peered":"2024-02-26T12:19:18.462775+0000","last_unstale":"2024-02-26T12:19:20.932590+0000","last_undegraded":"2024-02-26T12:19:20.932590+0000","last_fullsized":"2024-02-26T12:19:20.932590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932747+0000","last_change":"2024-02-26T12:19:19.462308+0000","last_active":"2024-02-26T12:19:20.932747+0000","last_peered":"2024-02-26T12:19:20.932747+0000","last_clean":"2024-02-26T12:19:20.932747+0000","last_became_active":"2024-02-26T12:19:19.462011+0000","last_became_peered":"2024-02-26T12:19:19.462011+0000","last_unstale":"2024-02-26T12:19:20.932747+0000","last_undegraded":"2024-02-26T12:19:20.932747+0000","last_fullsized":"2024-02-26T12:19:20.932747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452209+0000","last_change":"2024-02-26T12:19:18.456487+0000","last_active":"2024-02-26T12:19:20.452209+0000","last_peered":"2024-02-26T12:19:20.452209+0000","last_clean":"2024-02-26T12:19:20.452209+0000","last_became_active":"2024-02-26T12:19:18.456207+0000","last_became_peered":"2024-02-26T12:19:18.456207+0000","last_unstale":"2024-02-26T12:19:20.452209+0000","last_undegraded":"2024-02-26T12:19:20.452209+0000","last_fullsized":"2024-02-26T12:19:20.452209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449517+0000","last_change":"2024-02-26T12:19:19.460550+0000","last_active":"2024-02-26T12:19:20.449517+0000","last_peered":"2024-02-26T12:19:20.449517+0000","last_clean":"2024-02-26T12:19:20.449517+0000","last_became_active":"2024-02-26T12:19:19.460265+0000","last_became_peered":"2024-02-26T12:19:19.460265+0000","last_unstale":"2024-02-26T12:19:20.449517+0000","last_undegraded":"2024-02-26T12:19:20.449517+0000","last_fullsized":"2024-02-26T12:19:20.449517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469567+0000","last_change":"2024-02-26T12:19:18.464033+0000","last_active":"2024-02-26T12:19:20.469567+0000","last_peered":"2024-02-26T12:19:20.469567+0000","last_clean":"2024-02-26T12:19:20.469567+0000","last_became_active":"2024-02-26T12:19:18.463599+0000","last_became_peered":"2024-02-26T12:19:18.463599+0000","last_unstale":"2024-02-26T12:19:20.469567+0000","last_undegraded":"2024-02-26T12:19:20.469567+0000","last_fullsized":"2024-02-26T12:19:20.469567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453466+0000","last_change":"2024-02-26T12:19:19.476744+0000","last_active":"2024-02-26T12:19:20.453466+0000","last_peered":"2024-02-26T12:19:20.453466+0000","last_clean":"2024-02-26T12:19:20.453466+0000","last_became_active":"2024-02-26T12:19:19.476456+0000","last_became_peered":"2024-02-26T12:19:19.476456+0000","last_unstale":"2024-02-26T12:19:20.453466+0000","last_undegraded":"2024-02-26T12:19:20.453466+0000","last_fullsized":"2024-02-26T12:19:20.453466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453526+0000","last_change":"2024-02-26T12:19:18.461181+0000","last_active":"2024-02-26T12:19:20.453526+0000","last_peered":"2024-02-26T12:19:20.453526+0000","last_clean":"2024-02-26T12:19:20.453526+0000","last_became_active":"2024-02-26T12:19:18.460919+0000","last_became_peered":"2024-02-26T12:19:18.460919+0000","last_unstale":"2024-02-26T12:19:20.453526+0000","last_undegraded":"2024-02-26T12:19:20.453526+0000","last_fullsized":"2024-02-26T12:19:20.453526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933451+0000","last_change":"2024-02-26T12:19:19.456644+0000","last_active":"2024-02-26T12:19:20.933451+0000","last_peered":"2024-02-26T12:19:20.933451+0000","last_clean":"2024-02-26T12:19:20.933451+0000","last_became_active":"2024-02-26T12:19:19.456368+0000","last_became_peered":"2024-02-26T12:19:19.456368+0000","last_unstale":"2024-02-26T12:19:20.933451+0000","last_undegraded":"2024-02-26T12:19:20.933451+0000","last_fullsized":"2024-02-26T12:19:20.933451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449625+0000","last_change":"2024-02-26T12:19:18.461795+0000","last_active":"2024-02-26T12:19:20.449625+0000","last_peered":"2024-02-26T12:19:20.449625+0000","last_clean":"2024-02-26T12:19:20.449625+0000","last_became_active":"2024-02-26T12:19:18.460734+0000","last_became_peered":"2024-02-26T12:19:18.460734+0000","last_unstale":"2024-02-26T12:19:20.449625+0000","last_undegraded":"2024-02-26T12:19:20.449625+0000","last_fullsized":"2024-02-26T12:19:20.449625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453339+0000","last_change":"2024-02-26T12:19:19.466977+0000","last_active":"2024-02-26T12:19:20.453339+0000","last_peered":"2024-02-26T12:19:20.453339+0000","last_clean":"2024-02-26T12:19:20.453339+0000","last_became_active":"2024-02-26T12:19:19.466691+0000","last_became_peered":"2024-02-26T12:19:19.466691+0000","last_unstale":"2024-02-26T12:19:20.453339+0000","last_undegraded":"2024-02-26T12:19:20.453339+0000","last_fullsized":"2024-02-26T12:19:20.453339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:36.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469361+0000","last_change":"2024-02-26T12:19:18.464762+0000","last_active":"2024-02-26T12:19:20.469361+0000","last_peered":"2024-02-26T12:19:20.469361+0000","last_clean":"2024-02-26T12:19:20.469361+0000","last_became_active":"2024-02-26T12:19:18.464498+0000","last_became_peered":"2024-02-26T12:19:18.464498+0000","last_unstale":"2024-02-26T12:19:20.469361+0000","last_undegraded":"2024-02-26T12:19:20.469361+0000","last_fullsized":"2024-02-26T12:19:20.469361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932633+0000","last_change":"2024-02-26T12:19:19.470554+0000","last_active":"2024-02-26T12:19:20.932633+0000","last_peered":"2024-02-26T12:19:20.932633+0000","last_clean":"2024-02-26T12:19:20.932633+0000","last_became_active":"2024-02-26T12:19:19.470255+0000","last_became_peered":"2024-02-26T12:19:19.470255+0000","last_unstale":"2024-02-26T12:19:20.932633+0000","last_undegraded":"2024-02-26T12:19:20.932633+0000","last_fullsized":"2024-02-26T12:19:20.932633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933472+0000","last_change":"2024-02-26T12:19:18.460695+0000","last_active":"2024-02-26T12:19:20.933472+0000","last_peered":"2024-02-26T12:19:20.933472+0000","last_clean":"2024-02-26T12:19:20.933472+0000","last_became_active":"2024-02-26T12:19:18.460421+0000","last_became_peered":"2024-02-26T12:19:18.460421+0000","last_unstale":"2024-02-26T12:19:20.933472+0000","last_undegraded":"2024-02-26T12:19:20.933472+0000","last_fullsized":"2024-02-26T12:19:20.933472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:43:36.801064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933177+0000","last_change":"2024-02-26T12:19:19.474064+0000","last_active":"2024-02-26T12:19:20.933177+0000","last_peered":"2024-02-26T12:19:20.933177+0000","last_clean":"2024-02-26T12:19:20.933177+0000","last_became_active":"2024-02-26T12:19:19.473790+0000","last_became_peered":"2024-02-26T12:19:19.473790+0000","last_unstale":"2024-02-26T12:19:20.933177+0000","last_undegraded":"2024-02-26T12:19:20.933177+0000","last_fullsized":"2024-02-26T12:19:20.933177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:25.284013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452545+0000","last_change":"2024-02-26T12:19:18.455061+0000","last_active":"2024-02-26T12:19:20.452545+0000","last_peered":"2024-02-26T12:19:20.452545+0000","last_clean":"2024-02-26T12:19:20.452545+0000","last_became_active":"2024-02-26T12:19:18.454770+0000","last_became_peered":"2024-02-26T12:19:18.454770+0000","last_unstale":"2024-02-26T12:19:20.452545+0000","last_undegraded":"2024-02-26T12:19:20.452545+0000","last_fullsized":"2024-02-26T12:19:20.452545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932700+0000","last_change":"2024-02-26T12:19:19.477159+0000","last_active":"2024-02-26T12:19:20.932700+0000","last_peered":"2024-02-26T12:19:20.932700+0000","last_clean":"2024-02-26T12:19:20.932700+0000","last_became_active":"2024-02-26T12:19:19.476899+0000","last_became_peered":"2024-02-26T12:19:19.476899+0000","last_unstale":"2024-02-26T12:19:20.932700+0000","last_undegraded":"2024-02-26T12:19:20.932700+0000","last_fullsized":"2024-02-26T12:19:20.932700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469219+0000","last_change":"2024-02-26T12:19:18.463068+0000","last_active":"2024-02-26T12:19:20.469219+0000","last_peered":"2024-02-26T12:19:20.469219+0000","last_clean":"2024-02-26T12:19:20.469219+0000","last_became_active":"2024-02-26T12:19:18.462586+0000","last_became_peered":"2024-02-26T12:19:18.462586+0000","last_unstale":"2024-02-26T12:19:20.469219+0000","last_undegraded":"2024-02-26T12:19:20.469219+0000","last_fullsized":"2024-02-26T12:19:20.469219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469287+0000","last_change":"2024-02-26T12:19:19.465821+0000","last_active":"2024-02-26T12:19:20.469287+0000","last_peered":"2024-02-26T12:19:20.469287+0000","last_clean":"2024-02-26T12:19:20.469287+0000","last_became_active":"2024-02-26T12:19:19.465294+0000","last_became_peered":"2024-02-26T12:19:19.465294+0000","last_unstale":"2024-02-26T12:19:20.469287+0000","last_undegraded":"2024-02-26T12:19:20.469287+0000","last_fullsized":"2024-02-26T12:19:20.469287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932061+0000","last_change":"2024-02-26T12:19:18.461135+0000","last_active":"2024-02-26T12:19:20.932061+0000","last_peered":"2024-02-26T12:19:20.932061+0000","last_clean":"2024-02-26T12:19:20.932061+0000","last_became_active":"2024-02-26T12:19:18.460849+0000","last_became_peered":"2024-02-26T12:19:18.460849+0000","last_unstale":"2024-02-26T12:19:20.932061+0000","last_undegraded":"2024-02-26T12:19:20.932061+0000","last_fullsized":"2024-02-26T12:19:20.932061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:55:52.430631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.473888+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.473207+0000","last_became_peered":"2024-02-26T12:19:19.473207+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453157+0000","last_change":"2024-02-26T12:19:18.461104+0000","last_active":"2024-02-26T12:19:20.453157+0000","last_peered":"2024-02-26T12:19:20.453157+0000","last_clean":"2024-02-26T12:19:20.453157+0000","last_became_active":"2024-02-26T12:19:18.460836+0000","last_became_peered":"2024-02-26T12:19:18.460836+0000","last_unstale":"2024-02-26T12:19:20.453157+0000","last_undegraded":"2024-02-26T12:19:20.453157+0000","last_fullsized":"2024-02-26T12:19:20.453157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:47:30.665043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932927+0000","last_change":"2024-02-26T12:19:19.470461+0000","last_active":"2024-02-26T12:19:20.932927+0000","last_peered":"2024-02-26T12:19:20.932927+0000","last_clean":"2024-02-26T12:19:20.932927+0000","last_became_active":"2024-02-26T12:19:19.470152+0000","last_became_peered":"2024-02-26T12:19:19.470152+0000","last_unstale":"2024-02-26T12:19:20.932927+0000","last_undegraded":"2024-02-26T12:19:20.932927+0000","last_fullsized":"2024-02-26T12:19:20.932927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932510+0000","last_change":"2024-02-26T12:19:18.455812+0000","last_active":"2024-02-26T12:19:20.932510+0000","last_peered":"2024-02-26T12:19:20.932510+0000","last_clean":"2024-02-26T12:19:20.932510+0000","last_became_active":"2024-02-26T12:19:18.455182+0000","last_became_peered":"2024-02-26T12:19:18.455182+0000","last_unstale":"2024-02-26T12:19:20.932510+0000","last_undegraded":"2024-02-26T12:19:20.932510+0000","last_fullsized":"2024-02-26T12:19:20.932510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933136+0000","last_change":"2024-02-26T12:19:19.477606+0000","last_active":"2024-02-26T12:19:20.933136+0000","last_peered":"2024-02-26T12:19:20.933136+0000","last_clean":"2024-02-26T12:19:20.933136+0000","last_became_active":"2024-02-26T12:19:19.477293+0000","last_became_peered":"2024-02-26T12:19:19.477293+0000","last_unstale":"2024-02-26T12:19:20.933136+0000","last_undegraded":"2024-02-26T12:19:20.933136+0000","last_fullsized":"2024-02-26T12:19:20.933136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:07.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449697+0000","last_change":"2024-02-26T12:19:18.461425+0000","last_active":"2024-02-26T12:19:20.449697+0000","last_peered":"2024-02-26T12:19:20.449697+0000","last_clean":"2024-02-26T12:19:20.449697+0000","last_became_active":"2024-02-26T12:19:18.461141+0000","last_became_peered":"2024-02-26T12:19:18.461141+0000","last_unstale":"2024-02-26T12:19:20.449697+0000","last_undegraded":"2024-02-26T12:19:20.449697+0000","last_fullsized":"2024-02-26T12:19:20.449697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452805+0000","last_change":"2024-02-26T12:19:19.462834+0000","last_active":"2024-02-26T12:19:20.452805+0000","last_peered":"2024-02-26T12:19:20.452805+0000","last_clean":"2024-02-26T12:19:20.452805+0000","last_became_active":"2024-02-26T12:19:19.462465+0000","last_became_peered":"2024-02-26T12:19:19.462465+0000","last_unstale":"2024-02-26T12:19:20.452805+0000","last_undegraded":"2024-02-26T12:19:20.452805+0000","last_fullsized":"2024-02-26T12:19:20.452805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932370+0000","last_change":"2024-02-26T12:19:18.456646+0000","last_active":"2024-02-26T12:19:20.932370+0000","last_peered":"2024-02-26T12:19:20.932370+0000","last_clean":"2024-02-26T12:19:20.932370+0000","last_became_active":"2024-02-26T12:19:18.456316+0000","last_became_peered":"2024-02-26T12:19:18.456316+0000","last_unstale":"2024-02-26T12:19:20.932370+0000","last_undegraded":"2024-02-26T12:19:20.932370+0000","last_fullsized":"2024-02-26T12:19:20.932370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:15:21.737677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932817+0000","last_change":"2024-02-26T12:19:19.469817+0000","last_active":"2024-02-26T12:19:20.932817+0000","last_peered":"2024-02-26T12:19:20.932817+0000","last_clean":"2024-02-26T12:19:20.932817+0000","last_became_active":"2024-02-26T12:19:19.469355+0000","last_became_peered":"2024-02-26T12:19:19.469355+0000","last_unstale":"2024-02-26T12:19:20.932817+0000","last_undegraded":"2024-02-26T12:19:20.932817+0000","last_fullsized":"2024-02-26T12:19:20.932817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932422+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:19:20.932422+0000","last_peered":"2024-02-26T12:19:20.932422+0000","last_clean":"2024-02-26T12:19:20.932422+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:19:20.932422+0000","last_undegraded":"2024-02-26T12:19:20.932422+0000","last_fullsized":"2024-02-26T12:19:20.932422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452184+0000","last_change":"2024-02-26T12:19:18.456266+0000","last_active":"2024-02-26T12:19:20.452184+0000","last_peered":"2024-02-26T12:19:20.452184+0000","last_clean":"2024-02-26T12:19:20.452184+0000","last_became_active":"2024-02-26T12:19:18.455942+0000","last_became_peered":"2024-02-26T12:19:18.455942+0000","last_unstale":"2024-02-26T12:19:20.452184+0000","last_undegraded":"2024-02-26T12:19:20.452184+0000","last_fullsized":"2024-02-26T12:19:20.452184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933368+0000","last_change":"2024-02-26T12:19:19.470887+0000","last_active":"2024-02-26T12:19:20.933368+0000","last_peered":"2024-02-26T12:19:20.933368+0000","last_clean":"2024-02-26T12:19:20.933368+0000","last_became_active":"2024-02-26T12:19:19.470607+0000","last_became_peered":"2024-02-26T12:19:19.470607+0000","last_unstale":"2024-02-26T12:19:20.933368+0000","last_undegraded":"2024-02-26T12:19:20.933368+0000","last_fullsized":"2024-02-26T12:19:20.933368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932456+0000","last_change":"2024-02-26T12:19:18.465038+0000","last_active":"2024-02-26T12:19:20.932456+0000","last_peered":"2024-02-26T12:19:20.932456+0000","last_clean":"2024-02-26T12:19:20.932456+0000","last_became_active":"2024-02-26T12:19:18.464586+0000","last_became_peered":"2024-02-26T12:19:18.464586+0000","last_unstale":"2024-02-26T12:19:20.932456+0000","last_undegraded":"2024-02-26T12:19:20.932456+0000","last_fullsized":"2024-02-26T12:19:20.932456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932968+0000","last_change":"2024-02-26T12:19:19.453339+0000","last_active":"2024-02-26T12:19:20.932968+0000","last_peered":"2024-02-26T12:19:20.932968+0000","last_clean":"2024-02-26T12:19:20.932968+0000","last_became_active":"2024-02-26T12:19:19.453031+0000","last_became_peered":"2024-02-26T12:19:19.453031+0000","last_unstale":"2024-02-26T12:19:20.932968+0000","last_undegraded":"2024-02-26T12:19:20.932968+0000","last_fullsized":"2024-02-26T12:19:20.932968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932171+0000","last_change":"2024-02-26T12:19:18.455546+0000","last_active":"2024-02-26T12:19:20.932171+0000","last_peered":"2024-02-26T12:19:20.932171+0000","last_clean":"2024-02-26T12:19:20.932171+0000","last_became_active":"2024-02-26T12:19:18.455214+0000","last_became_peered":"2024-02-26T12:19:18.455214+0000","last_unstale":"2024-02-26T12:19:20.932171+0000","last_undegraded":"2024-02-26T12:19:20.932171+0000","last_fullsized":"2024-02-26T12:19:20.932171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449348+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.449348+0000","last_peered":"2024-02-26T12:19:20.449348+0000","last_clean":"2024-02-26T12:19:20.449348+0000","last_became_active":"2024-02-26T12:19:19.458568+0000","last_became_peered":"2024-02-26T12:19:19.458568+0000","last_unstale":"2024-02-26T12:19:20.449348+0000","last_undegraded":"2024-02-26T12:19:20.449348+0000","last_fullsized":"2024-02-26T12:19:20.449348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452642+0000","last_change":"2024-02-26T12:19:18.462392+0000","last_active":"2024-02-26T12:19:20.452642+0000","last_peered":"2024-02-26T12:19:20.452642+0000","last_clean":"2024-02-26T12:19:20.452642+0000","last_became_active":"2024-02-26T12:19:18.462102+0000","last_became_peered":"2024-02-26T12:19:18.462102+0000","last_unstale":"2024-02-26T12:19:20.452642+0000","last_undegraded":"2024-02-26T12:19:20.452642+0000","last_fullsized":"2024-02-26T12:19:20.452642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453404+0000","last_change":"2024-02-26T12:19:19.457056+0000","last_active":"2024-02-26T12:19:20.453404+0000","last_peered":"2024-02-26T12:19:20.453404+0000","last_clean":"2024-02-26T12:19:20.453404+0000","last_became_active":"2024-02-26T12:19:19.456475+0000","last_became_peered":"2024-02-26T12:19:19.456475+0000","last_unstale":"2024-02-26T12:19:20.453404+0000","last_undegraded":"2024-02-26T12:19:20.453404+0000","last_fullsized":"2024-02-26T12:19:20.453404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449511+0000","last_change":"2024-02-26T12:19:18.460143+0000","last_active":"2024-02-26T12:19:20.449511+0000","last_peered":"2024-02-26T12:19:20.449511+0000","last_clean":"2024-02-26T12:19:20.449511+0000","last_became_active":"2024-02-26T12:19:18.459858+0000","last_became_peered":"2024-02-26T12:19:18.459858+0000","last_unstale":"2024-02-26T12:19:20.449511+0000","last_undegraded":"2024-02-26T12:19:20.449511+0000","last_fullsized":"2024-02-26T12:19:20.449511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453144+0000","last_change":"2024-02-26T12:19:19.462914+0000","last_active":"2024-02-26T12:19:20.453144+0000","last_peered":"2024-02-26T12:19:20.453144+0000","last_clean":"2024-02-26T12:19:20.453144+0000","last_became_active":"2024-02-26T12:19:19.462335+0000","last_became_peered":"2024-02-26T12:19:19.462335+0000","last_unstale":"2024-02-26T12:19:20.453144+0000","last_undegraded":"2024-02-26T12:19:20.453144+0000","last_fullsized":"2024-02-26T12:19:20.453144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932953+0000","last_change":"2024-02-26T12:19:18.464084+0000","last_active":"2024-02-26T12:19:20.932953+0000","last_peered":"2024-02-26T12:19:20.932953+0000","last_clean":"2024-02-26T12:19:20.932953+0000","last_became_active":"2024-02-26T12:19:18.463367+0000","last_became_peered":"2024-02-26T12:19:18.463367+0000","last_unstale":"2024-02-26T12:19:20.932953+0000","last_undegraded":"2024-02-26T12:19:20.932953+0000","last_fullsized":"2024-02-26T12:19:20.932953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449431+0000","last_change":"2024-02-26T12:19:19.461058+0000","last_active":"2024-02-26T12:19:20.449431+0000","last_peered":"2024-02-26T12:19:20.449431+0000","last_clean":"2024-02-26T12:19:20.449431+0000","last_became_active":"2024-02-26T12:19:19.460767+0000","last_became_peered":"2024-02-26T12:19:19.460767+0000","last_unstale":"2024-02-26T12:19:20.449431+0000","last_undegraded":"2024-02-26T12:19:20.449431+0000","last_fullsized":"2024-02-26T12:19:20.449431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.468823+0000","last_change":"2024-02-26T12:19:18.463879+0000","last_active":"2024-02-26T12:19:20.468823+0000","last_peered":"2024-02-26T12:19:20.468823+0000","last_clean":"2024-02-26T12:19:20.468823+0000","last_became_active":"2024-02-26T12:19:18.463588+0000","last_became_peered":"2024-02-26T12:19:18.463588+0000","last_unstale":"2024-02-26T12:19:20.468823+0000","last_undegraded":"2024-02-26T12:19:20.468823+0000","last_fullsized":"2024-02-26T12:19:20.468823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932829+0000","last_change":"2024-02-26T12:19:19.472563+0000","last_active":"2024-02-26T12:19:20.932829+0000","last_peered":"2024-02-26T12:19:20.932829+0000","last_clean":"2024-02-26T12:19:20.932829+0000","last_became_active":"2024-02-26T12:19:19.472300+0000","last_became_peered":"2024-02-26T12:19:19.472300+0000","last_unstale":"2024-02-26T12:19:20.932829+0000","last_undegraded":"2024-02-26T12:19:20.932829+0000","last_fullsized":"2024-02-26T12:19:20.932829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469619+0000","last_change":"2024-02-26T12:19:18.464144+0000","last_active":"2024-02-26T12:19:20.469619+0000","last_peered":"2024-02-26T12:19:20.469619+0000","last_clean":"2024-02-26T12:19:20.469619+0000","last_became_active":"2024-02-26T12:19:18.462912+0000","last_became_peered":"2024-02-26T12:19:18.462912+0000","last_unstale":"2024-02-26T12:19:20.469619+0000","last_undegraded":"2024-02-26T12:19:20.469619+0000","last_fullsized":"2024-02-26T12:19:20.469619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933409+0000","last_change":"2024-02-26T12:19:19.462865+0000","last_active":"2024-02-26T12:19:20.933409+0000","last_peered":"2024-02-26T12:19:20.933409+0000","last_clean":"2024-02-26T12:19:20.933409+0000","last_became_active":"2024-02-26T12:19:19.460986+0000","last_became_peered":"2024-02-26T12:19:19.460986+0000","last_unstale":"2024-02-26T12:19:20.933409+0000","last_undegraded":"2024-02-26T12:19:20.933409+0000","last_fullsized":"2024-02-26T12:19:20.933409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932323+0000","last_change":"2024-02-26T12:19:18.461638+0000","last_active":"2024-02-26T12:19:20.932323+0000","last_peered":"2024-02-26T12:19:20.932323+0000","last_clean":"2024-02-26T12:19:20.932323+0000","last_became_active":"2024-02-26T12:19:18.461352+0000","last_became_peered":"2024-02-26T12:19:18.461352+0000","last_unstale":"2024-02-26T12:19:20.932323+0000","last_undegraded":"2024-02-26T12:19:20.932323+0000","last_fullsized":"2024-02-26T12:19:20.932323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453133+0000","last_change":"2024-02-26T12:19:19.455737+0000","last_active":"2024-02-26T12:19:20.453133+0000","last_peered":"2024-02-26T12:19:20.453133+0000","last_clean":"2024-02-26T12:19:20.453133+0000","last_became_active":"2024-02-26T12:19:19.454845+0000","last_became_peered":"2024-02-26T12:19:19.454845+0000","last_unstale":"2024-02-26T12:19:20.453133+0000","last_undegraded":"2024-02-26T12:19:20.453133+0000","last_fullsized":"2024-02-26T12:19:20.453133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:08.196993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449440+0000","last_change":"2024-02-26T12:19:18.462514+0000","last_active":"2024-02-26T12:19:20.449440+0000","last_peered":"2024-02-26T12:19:20.449440+0000","last_clean":"2024-02-26T12:19:20.449440+0000","last_became_active":"2024-02-26T12:19:18.461749+0000","last_became_peered":"2024-02-26T12:19:18.461749+0000","last_unstale":"2024-02-26T12:19:20.449440+0000","last_undegraded":"2024-02-26T12:19:20.449440+0000","last_fullsized":"2024-02-26T12:19:20.449440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932875+0000","last_change":"2024-02-26T12:19:19.461344+0000","last_active":"2024-02-26T12:19:20.932875+0000","last_peered":"2024-02-26T12:19:20.932875+0000","last_clean":"2024-02-26T12:19:20.932875+0000","last_became_active":"2024-02-26T12:19:19.461069+0000","last_became_peered":"2024-02-26T12:19:19.461069+0000","last_unstale":"2024-02-26T12:19:20.932875+0000","last_undegraded":"2024-02-26T12:19:20.932875+0000","last_fullsized":"2024-02-26T12:19:20.932875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449411+0000","last_change":"2024-02-26T12:19:18.459629+0000","last_active":"2024-02-26T12:19:20.449411+0000","last_peered":"2024-02-26T12:19:20.449411+0000","last_clean":"2024-02-26T12:19:20.449411+0000","last_became_active":"2024-02-26T12:19:18.459350+0000","last_became_peered":"2024-02-26T12:19:18.459350+0000","last_unstale":"2024-02-26T12:19:20.449411+0000","last_undegraded":"2024-02-26T12:19:20.449411+0000","last_fullsized":"2024-02-26T12:19:20.449411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932758+0000","last_change":"2024-02-26T12:19:19.460693+0000","last_active":"2024-02-26T12:19:20.932758+0000","last_peered":"2024-02-26T12:19:20.932758+0000","last_clean":"2024-02-26T12:19:20.932758+0000","last_became_active":"2024-02-26T12:19:19.459680+0000","last_became_peered":"2024-02-26T12:19:19.459680+0000","last_unstale":"2024-02-26T12:19:20.932758+0000","last_undegraded":"2024-02-26T12:19:20.932758+0000","last_fullsized":"2024-02-26T12:19:20.932758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932791+0000","last_change":"2024-02-26T12:19:18.461202+0000","last_active":"2024-02-26T12:19:20.932791+0000","last_peered":"2024-02-26T12:19:20.932791+0000","last_clean":"2024-02-26T12:19:20.932791+0000","last_became_active":"2024-02-26T12:19:18.460874+0000","last_became_peered":"2024-02-26T12:19:18.460874+0000","last_unstale":"2024-02-26T12:19:20.932791+0000","last_undegraded":"2024-02-26T12:19:20.932791+0000","last_fullsized":"2024-02-26T12:19:20.932791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:16.993521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469337+0000","last_change":"2024-02-26T12:19:19.465226+0000","last_active":"2024-02-26T12:19:20.469337+0000","last_peered":"2024-02-26T12:19:20.469337+0000","last_clean":"2024-02-26T12:19:20.469337+0000","last_became_active":"2024-02-26T12:19:19.464959+0000","last_became_peered":"2024-02-26T12:19:19.464959+0000","last_unstale":"2024-02-26T12:19:20.469337+0000","last_undegraded":"2024-02-26T12:19:20.469337+0000","last_fullsized":"2024-02-26T12:19:20.469337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452990+0000","last_change":"2024-02-26T12:19:19.458902+0000","last_active":"2024-02-26T12:19:20.452990+0000","last_peered":"2024-02-26T12:19:20.452990+0000","last_clean":"2024-02-26T12:19:20.452990+0000","last_became_active":"2024-02-26T12:19:19.458618+0000","last_became_peered":"2024-02-26T12:19:19.458618+0000","last_unstale":"2024-02-26T12:19:20.452990+0000","last_undegraded":"2024-02-26T12:19:20.452990+0000","last_fullsized":"2024-02-26T12:19:20.452990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932599+0000","last_change":"2024-02-26T12:19:18.461020+0000","last_active":"2024-02-26T12:19:20.932599+0000","last_peered":"2024-02-26T12:19:20.932599+0000","last_clean":"2024-02-26T12:19:20.932599+0000","last_became_active":"2024-02-26T12:19:18.460670+0000","last_became_peered":"2024-02-26T12:19:18.460670+0000","last_unstale":"2024-02-26T12:19:20.932599+0000","last_undegraded":"2024-02-26T12:19:20.932599+0000","last_fullsized":"2024-02-26T12:19:20.932599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452392+0000","last_change":"2024-02-26T12:19:19.458148+0000","last_active":"2024-02-26T12:19:20.452392+0000","last_peered":"2024-02-26T12:19:20.452392+0000","last_clean":"2024-02-26T12:19:20.452392+0000","last_became_active":"2024-02-26T12:19:19.457530+0000","last_became_peered":"2024-02-26T12:19:19.457530+0000","last_unstale":"2024-02-26T12:19:20.452392+0000","last_undegraded":"2024-02-26T12:19:20.452392+0000","last_fullsized":"2024-02-26T12:19:20.452392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932807+0000","last_change":"2024-02-26T12:19:18.465248+0000","last_active":"2024-02-26T12:19:20.932807+0000","last_peered":"2024-02-26T12:19:20.932807+0000","last_clean":"2024-02-26T12:19:20.932807+0000","last_became_active":"2024-02-26T12:19:18.464973+0000","last_became_peered":"2024-02-26T12:19:18.464973+0000","last_unstale":"2024-02-26T12:19:20.932807+0000","last_undegraded":"2024-02-26T12:19:20.932807+0000","last_fullsized":"2024-02-26T12:19:20.932807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933345+0000","last_change":"2024-02-26T12:19:19.463869+0000","last_active":"2024-02-26T12:19:20.933345+0000","last_peered":"2024-02-26T12:19:20.933345+0000","last_clean":"2024-02-26T12:19:20.933345+0000","last_became_active":"2024-02-26T12:19:19.463540+0000","last_became_peered":"2024-02-26T12:19:19.463540+0000","last_unstale":"2024-02-26T12:19:20.933345+0000","last_undegraded":"2024-02-26T12:19:20.933345+0000","last_fullsized":"2024-02-26T12:19:20.933345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932626+0000","last_change":"2024-02-26T12:19:18.459968+0000","last_active":"2024-02-26T12:19:20.932626+0000","last_peered":"2024-02-26T12:19:20.932626+0000","last_clean":"2024-02-26T12:19:20.932626+0000","last_became_active":"2024-02-26T12:19:18.459646+0000","last_became_peered":"2024-02-26T12:19:18.459646+0000","last_unstale":"2024-02-26T12:19:20.932626+0000","last_undegraded":"2024-02-26T12:19:20.932626+0000","last_fullsized":"2024-02-26T12:19:20.932626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932466+0000","last_change":"2024-02-26T12:19:19.468378+0000","last_active":"2024-02-26T12:19:20.932466+0000","last_peered":"2024-02-26T12:19:20.932466+0000","last_clean":"2024-02-26T12:19:20.932466+0000","last_became_active":"2024-02-26T12:19:19.467864+0000","last_became_peered":"2024-02-26T12:19:19.467864+0000","last_unstale":"2024-02-26T12:19:20.932466+0000","last_undegraded":"2024-02-26T12:19:20.932466+0000","last_fullsized":"2024-02-26T12:19:20.932466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933450+0000","last_change":"2024-02-26T12:19:18.463225+0000","last_active":"2024-02-26T12:19:20.933450+0000","last_peered":"2024-02-26T12:19:20.933450+0000","last_clean":"2024-02-26T12:19:20.933450+0000","last_became_active":"2024-02-26T12:19:18.462195+0000","last_became_peered":"2024-02-26T12:19:18.462195+0000","last_unstale":"2024-02-26T12:19:20.933450+0000","last_undegraded":"2024-02-26T12:19:20.933450+0000","last_fullsized":"2024-02-26T12:19:20.933450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:08:24.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:19:23.734 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-26T12:19:23.734 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-26T12:19:23.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-26T12:19:23.735 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-26T12:19:23.735 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-26T12:19:23.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.883+0000 7f09fca60640 1 Processor -- start 2024-02-26T12:19:23.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.883+0000 7f09fca60640 1 -- start start 2024-02-26T12:19:23.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09fca60640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 0x7f09f806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09fca60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09f806baa0 0x7f09f8161840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09fca60640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f80cf8e0 con 0x7f09f815dcb0 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09fca60640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f80cc730 con 0x7f09f806baa0 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09fca60640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f80cc120 con 0x7f09f8066a00 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09f6d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09f806baa0 0x7f09f8161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09f659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f09f815dcb0 0x7f09f80ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57952/0 (socket says 172.21.15.113:57952) 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.884+0000 7f09f659c640 1 -- 172.21.15.113:0/2830246257 learned_addr learned my addr 172.21.15.113:0/2830246257 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f6d9d640 1 -- 172.21.15.113:0/2830246257 >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 msgr2=0x7f09f806b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:23.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/2830246257 >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 0x7f09f806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f559a640 1 -- 172.21.15.113:0/2830246257 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13886142 0 0) 0x7f09f80cf8e0 con 0x7f09f815dcb0 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f6d9d640 1 --2- 172.21.15.113:0/2830246257 >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 0x7f09f806b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f6d9d640 1 -- 172.21.15.113:0/2830246257 >> v1:172.21.15.113:6789/0 conn(0x7f09f815dcb0 legacy=0x7f09f80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f6d9d640 1 -- 172.21.15.113:0/2830246257 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f815e090 con 0x7f09f806baa0 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/2830246257 >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 0x7f09f806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.885+0000 7f09f6d9d640 1 --2- 172.21.15.113:0/2830246257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f806baa0 0x7f09f8161840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f09f806c660 tx=0x7f09e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffe05345c181334 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09f559a640 1 -- 172.21.15.113:0/2830246257 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80315a0 con 0x7f09f806baa0 2024-02-26T12:19:23.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09f559a640 1 -- 172.21.15.113:0/2830246257 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8037070 con 0x7f09f806baa0 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09f559a640 1 -- 172.21.15.113:0/2830246257 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8031960 con 0x7f09f806baa0 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 -- 172.21.15.113:0/2830246257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f806baa0 msgr2=0x7f09f8161840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 --2- 172.21.15.113:0/2830246257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f806baa0 0x7f09f8161840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f09f806c660 tx=0x7f09e802b840 comp rx=0 tx=0).stop 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 -- 172.21.15.113:0/2830246257 shutdown_connections 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 --2- 172.21.15.113:0/2830246257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f806baa0 0x7f09f8161840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 --2- 172.21.15.113:0/2830246257 >> v2:172.21.15.152:3300/0 conn(0x7f09f8066a00 0x7f09f806b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 -- 172.21.15.113:0/2830246257 >> 172.21.15.113:0/2830246257 conn(0x7f09f80cc9f0 msgr2=0x7f09f80ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:23.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 -- 172.21.15.113:0/2830246257 shutdown_connections 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.886+0000 7f09fca60640 1 -- 172.21.15.113:0/2830246257 wait complete. 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.887+0000 7f09fca60640 1 Processor -- start 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.887+0000 7f09fca60640 1 -- start start 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 0x7f09f80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 0x7f09f815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80ced10 con 0x7f09f8066a00 2024-02-26T12:19:23.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80cc3c0 con 0x7f09f806baa0 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09fca60640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f806bf30 con 0x7f09f815dcb0 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09f659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09f659c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38216/0 (socket says 172.21.15.113:38216) 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.888+0000 7f09f659c640 1 -- 172.21.15.113:0/1240584090 learned_addr learned my addr 172.21.15.113:0/1240584090 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 0x7f09f80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f6d9d640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 0x7f09f815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 -- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 msgr2=0x7f09f815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 0x7f09f815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 -- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 msgr2=0x7f09f80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 0x7f09f80b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 -- 172.21.15.113:0/1240584090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f80b4490 con 0x7f09f8066a00 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 0x7f09f80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f6d9d640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 0x7f09f815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09f659c640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c430 tx=0x7f09f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f00074e0 con 0x7f09f8066a00 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f00047e0 con 0x7f09f8066a00 2024-02-26T12:19:23.883 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0004bd0 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f80b4770 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.889+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f80b4d30 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.890+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8074a50 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.890+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09f0011070 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.891+0000 7f09e6ffd640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 0x7f09d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.891+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09f0089e70 con 0x7f09f8066a00 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.891+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 0x7f09d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:23.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.891+0000 7f09f5d9b640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 0x7f09d806d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09f806fed0 tx=0x7f09ec007530 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:23.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:23.895+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09f0058cf0 con 0x7f09f8066a00 2024-02-26T12:19:24.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.113+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f09f80b5ef0 con 0x7f09f8066a00 2024-02-26T12:19:24.101 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.116+0000 7f09e6ffd640 1 -- 172.21.15.113:0/1240584090 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171788 (secure 0 0 0) 0x7f09f00585f0 con 0x7f09f8066a00 2024-02-26T12:19:24.103 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.118+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 msgr2=0x7f09d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.118+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 0x7f09d806d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09f806fed0 tx=0x7f09ec007530 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.118+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 msgr2=0x7f09f8154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.118+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c430 tx=0x7f09f000c8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 shutdown_connections 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09d806b500 0x7f09d806d9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f815dcb0 0x7f09f815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f806baa0 0x7f09f80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 --2- 172.21.15.113:0/1240584090 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8066a00 0x7f09f8154990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 >> 172.21.15.113:0/1240584090 conn(0x7f09f80cc9f0 msgr2=0x7f09f806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 shutdown_connections 2024-02-26T12:19:24.105 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.119+0000 7f09fca60640 1 -- 172.21.15.113:0/1240584090 wait complete. 2024-02-26T12:19:24.114 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":734952106},{"type":"v1","addr":"172.21.15.113:6833","nonce":734952106}]},"active_addr":"172.21.15.113:6833/734952106","active_change":"2024-02-26T12:18:59.144045+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":1452618478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":320498478}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":4010372970}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.113:0","nonce":3505635241}]}]} 2024-02-26T12:19:24.117 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-26T12:19:24.117 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-26T12:19:24.118 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:24.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.232+0000 7f36d98a2640 1 Processor -- start 2024-02-26T12:19:24.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.232+0000 7f36d98a2640 1 -- start start 2024-02-26T12:19:24.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d98a2640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 0x7f36d40716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d98a2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36d40b3350 0x7f36d40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d98a2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d4071bf0 con 0x7f36d40d0d00 2024-02-26T12:19:24.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d98a2640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d4070c60 con 0x7f36d40b3350 2024-02-26T12:19:24.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d98a2640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d40cc8a0 con 0x7f36d415bb50 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36d40b3350 0x7f36d40b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f36d40b3350 0x7f36d40b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38226/0 (socket says 172.21.15.113:38226) 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 -- 172.21.15.113:0/1680113758 learned_addr learned my addr 172.21.15.113:0/1680113758 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d2ffd640 1 --2- 172.21.15.113:0/1680113758 >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 0x7f36d40716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 -- 172.21.15.113:0/1680113758 >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 msgr2=0x7f36d40716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 --2- 172.21.15.113:0/1680113758 >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 0x7f36d40716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 -- 172.21.15.113:0/1680113758 >> v1:172.21.15.152:6789/0 conn(0x7f36d40d0d00 legacy=0x7f36d40cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d37fe640 1 -- 172.21.15.113:0/1680113758 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d40ccb80 con 0x7f36d40b3350 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.233+0000 7f36d2ffd640 1 --2- 172.21.15.113:0/1680113758 >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 0x7f36d40716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.234+0000 7f36d37fe640 1 --2- 172.21.15.113:0/1680113758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d40b3350 0x7f36d40b37e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36d40b4480 tx=0x7f36cc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707fe81878bf5c39 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.234+0000 7f36d1ffb640 1 -- 172.21.15.113:0/1680113758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc02c9f0 con 0x7f36d40b3350 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.234+0000 7f36d1ffb640 1 -- 172.21.15.113:0/1680113758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc02cb90 con 0x7f36d40b3350 2024-02-26T12:19:24.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.234+0000 7f36d1ffb640 1 -- 172.21.15.113:0/1680113758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0343f0 con 0x7f36d40b3350 2024-02-26T12:19:24.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 -- 172.21.15.113:0/1680113758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d40b3350 msgr2=0x7f36d40b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 --2- 172.21.15.113:0/1680113758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d40b3350 0x7f36d40b37e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36d40b4480 tx=0x7f36cc02be50 comp rx=0 tx=0).stop 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 -- 172.21.15.113:0/1680113758 shutdown_connections 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 --2- 172.21.15.113:0/1680113758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d40b3350 0x7f36d40b37e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 --2- 172.21.15.113:0/1680113758 >> v2:172.21.15.152:3300/0 conn(0x7f36d415bb50 0x7f36d40716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 -- 172.21.15.113:0/1680113758 >> 172.21.15.113:0/1680113758 conn(0x7f36d40ce350 msgr2=0x7f36d40ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 -- 172.21.15.113:0/1680113758 shutdown_connections 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.235+0000 7f36d98a2640 1 -- 172.21.15.113:0/1680113758 wait complete. 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.236+0000 7f36d98a2640 1 Processor -- start 2024-02-26T12:19:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.236+0000 7f36d98a2640 1 -- start start 2024-02-26T12:19:24.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36d40b3350 0x7f36d406c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d40d0d00 0x7f36d4151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d415bf30 con 0x7f36d415bb50 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4071190 con 0x7f36d40d0d00 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d98a2640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d41543a0 con 0x7f36d40b3350 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38238/0 (socket says 172.21.15.113:38238) 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 -- 172.21.15.113:0/3516397497 learned_addr learned my addr 172.21.15.113:0/3516397497 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d27fc640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d40d0d00 0x7f36d4151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 -- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36d40b3350 msgr2=0x7f36d406c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36d40b3350 0x7f36d406c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 -- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d40d0d00 msgr2=0x7f36d4151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d40d0d00 0x7f36d4151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 -- 172.21.15.113:0/3516397497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d415c3e0 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36d37fe640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009f40 tx=0x7f36cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc043020 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.237+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc03e450 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.238+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc03e820 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.238+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d415c6c0 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.238+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d415cc80 con 0x7f36d415bb50 2024-02-26T12:19:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.238+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4074a50 con 0x7f36d415bb50 2024-02-26T12:19:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.239+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36cc046020 con 0x7f36d415bb50 2024-02-26T12:19:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.239+0000 7f36bbfff640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 0x7f36c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.239+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36cc0acb70 con 0x7f36d415bb50 2024-02-26T12:19:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.239+0000 7f36d2ffd640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 0x7f36c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.240+0000 7f36d2ffd640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 0x7f36c006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006fd0 tx=0x7f36c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.243+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36cc04d030 con 0x7f36d415bb50 2024-02-26T12:19:24.401 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.416+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36d40d0ac0 con 0x7f36d415bb50 2024-02-26T12:19:24.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.417+0000 7f36bbfff640 1 -- 172.21.15.113:0/3516397497 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f36cc07b9f0 con 0x7f36d415bb50 2024-02-26T12:19:24.402 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:24.403 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 msgr2=0x7f36c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 0x7f36c006d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f36c4006fd0 tx=0x7f36c4008040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 msgr2=0x7f36d415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009f40 tx=0x7f36cc004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 shutdown_connections 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f36c006b4d0 0x7f36c006d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f36d415bb50 0x7f36d415d1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d40d0d00 0x7f36d4151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 --2- 172.21.15.113:0/3516397497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36d40b3350 0x7f36d406c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 >> 172.21.15.113:0/3516397497 conn(0x7f36d40ce350 msgr2=0x7f36d40ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 shutdown_connections 2024-02-26T12:19:24.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.419+0000 7f36d98a2640 1 -- 172.21.15.113:0/3516397497 wait complete. 2024-02-26T12:19:24.415 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-26T12:19:24.415 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:24.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.531+0000 7f8cfe0d5640 1 Processor -- start 2024-02-26T12:19:24.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.531+0000 7f8cfe0d5640 1 -- start start 2024-02-26T12:19:24.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.531+0000 7f8cfe0d5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf8154600 0x7f8cf806d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cfe0d5640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 0x7f8cf80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cfe0d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf8071730 0x7f8cf815dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cfe0d5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf8071bc0 con 0x7f8cf8154600 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cfe0d5640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf806e760 con 0x7f8cf815b340 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cfe0d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf806db50 con 0x7f8cf8071730 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf8154600 0x7f8cf806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cf8154600 0x7f8cf806d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38246/0 (socket says 172.21.15.113:38246) 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 -- 172.21.15.113:0/2595249888 learned_addr learned my addr 172.21.15.113:0/2595249888 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 -- 172.21.15.113:0/2595249888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf8071730 msgr2=0x7f8cf815dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/2595249888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf8071730 0x7f8cf815dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 -- 172.21.15.113:0/2595249888 >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 msgr2=0x7f8cf80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/2595249888 >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 0x7f8cf80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/2595249888 >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 0x7f8cf80711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf77fe640 1 -- 172.21.15.113:0/2595249888 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf806de30 con 0x7f8cf8154600 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.532+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/2595249888 >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 0x7f8cf80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/2595249888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8154600 0x7f8cf806d250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cf806ef50 tx=0x7f8ce802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4129c1763412978c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cf67fc640 1 -- 172.21.15.113:0/2595249888 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8035020 con 0x7f8cf8154600 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cf67fc640 1 -- 172.21.15.113:0/2595249888 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8031870 con 0x7f8cf8154600 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cf67fc640 1 -- 172.21.15.113:0/2595249888 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8031c40 con 0x7f8cf8154600 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/2595249888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8154600 msgr2=0x7f8cf806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/2595249888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8154600 0x7f8cf806d250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cf806ef50 tx=0x7f8ce802b910 comp rx=0 tx=0).stop 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/2595249888 shutdown_connections 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/2595249888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf8071730 0x7f8cf815dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/2595249888 >> v2:172.21.15.152:3300/0 conn(0x7f8cf815b340 0x7f8cf80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/2595249888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8154600 0x7f8cf806d250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/2595249888 >> 172.21.15.113:0/2595249888 conn(0x7f8cf806ab50 msgr2=0x7f8cf806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/2595249888 shutdown_connections 2024-02-26T12:19:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.533+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/2595249888 wait complete. 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.534+0000 7f8cfe0d5640 1 Processor -- start 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 -- start start 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf8154600 0x7f8cf8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf815b340 0x7f8cf80ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81549e0 con 0x7f8cf8071730 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf806e3f0 con 0x7f8cf8154600 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cfe0d5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf8154b60 con 0x7f8cf815b340 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cf77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cf77fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38248/0 (socket says 172.21.15.113:38248) 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.535+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3290047888 learned_addr learned my addr 172.21.15.113:0/3290047888 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf8154600 0x7f8cf8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf7fff640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf815b340 0x7f8cf80ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf815b340 msgr2=0x7f8cf80ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf815b340 0x7f8cf80ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf8154600 msgr2=0x7f8cf8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf8154600 0x7f8cf8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 -- 172.21.15.113:0/3290047888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf80cd950 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cf77fe640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000c00 tx=0x7f8ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8040070 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce803a420 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf80cdbd0 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8035040 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.536+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf81e4400 con 0x7f8cf8071730 2024-02-26T12:19:24.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.537+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf8074a50 con 0x7f8cf8071730 2024-02-26T12:19:24.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.537+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ce804b060 con 0x7f8cf8071730 2024-02-26T12:19:24.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.538+0000 7f8cdffff640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 0x7f8ce406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.538+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce80ac110 con 0x7f8cf8071730 2024-02-26T12:19:24.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.538+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 0x7f8ce406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.538+0000 7f8cf6ffd640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 0x7f8ce406d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cf81e2100 tx=0x7f8cec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.542+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8cf80cd950 con 0x7f8cf8071730 2024-02-26T12:19:24.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.712+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf80cdf60 con 0x7f8cf8071730 2024-02-26T12:19:24.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.713+0000 7f8cdffff640 1 -- 172.21.15.113:0/3290047888 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f8ce807b020 con 0x7f8cf8071730 2024-02-26T12:19:24.698 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:24.698 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:24.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 msgr2=0x7f8ce406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 0x7f8ce406d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cf81e2100 tx=0x7f8cec008040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 msgr2=0x7f8cf80ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8000c00 tx=0x7f8ce80046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 shutdown_connections 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8ce406b4d0 0x7f8ce406d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8cf815b340 0x7f8cf80ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8cf8154600 0x7f8cf8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 --2- 172.21.15.113:0/3290047888 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cf8071730 0x7f8cf80ce9a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 >> 172.21.15.113:0/3290047888 conn(0x7f8cf806ab50 msgr2=0x7f8cf81537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 shutdown_connections 2024-02-26T12:19:24.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.715+0000 7f8cfe0d5640 1 -- 172.21.15.113:0/3290047888 wait complete. 2024-02-26T12:19:24.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-26T12:19:24.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-26T12:19:24.714 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-26T12:19:24.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-26T12:19:24.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-26T12:19:24.716 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-26T12:19:24.716 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-26T12:19:24.716 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.897+0000 7f04baede640 1 Processor -- start 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.897+0000 7f04baede640 1 -- start start 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.898+0000 7f04baede640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f04b40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.898+0000 7f04baede640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b40b1180 con 0x7f04b4162200 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.898+0000 7f04baede640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b40b1460 con 0x7f04b4166900 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.898+0000 7f04baede640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40cf820 con 0x7f04b40c3800 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.899+0000 7f04b8c7a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f04b4162200 0x7f04b40b0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57956/0 (socket says 172.21.15.113:57956) 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.899+0000 7f04b8c7a640 1 -- 172.21.15.113:0/3392669782 learned_addr learned my addr 172.21.15.113:0/3392669782 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.899+0000 7f04b947b640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f04b40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.899+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586913699 0 0) 0x7f04b40b1180 con 0x7f04b4162200 2024-02-26T12:19:24.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.899+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f049c003520 con 0x7f04b4162200 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848221736 0 0) 0x7f049c003520 con 0x7f04b4162200 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 msgr2=0x7f04b40c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f04b40c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 >> v1:172.21.15.152:6789/0 conn(0x7f04b4166900 legacy=0x7f04b40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40b1740 con 0x7f04b4162200 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b947b640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f04b40c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f04a8001670 con 0x7f04b4162200 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 >> v1:172.21.15.113:6789/0 conn(0x7f04b4162200 legacy=0x7f04b40b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f049c0039e0 0x7f049c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f049c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c004e60 0x7f049c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f049c0039e0 0x7f049c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40cf820 con 0x7f049c004e60 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0054f0 con 0x7f049c0039e0 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c00bf00 con 0x7f04b40c3800 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7f04b3fff640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f049c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.900+0000 7ff320a36640 1 Processor -- start 2024-02-26T12:19:24.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7ff320a36640 1 -- start start 2024-02-26T12:19:24.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b947b640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c004e60 0x7f049c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7fb20762d640 1 Processor -- start 2024-02-26T12:19:24.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7fb20762d640 1 -- start start 2024-02-26T12:19:24.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7efe6b220640 1 Processor -- start 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff320a36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 0x7ff31c0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff320a36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff320a36640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c0cd190 con 0x7ff31c0c3760 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff320a36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c0cd470 con 0x7ff31c0cdf50 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff320a36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0cd750 con 0x7ff31c06ed20 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b8c7a640 1 -- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 msgr2=0x7f049c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b40c3800 0x7f049c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b8c7a640 1 -- 172.21.15.113:0/3392669782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c004e60 msgr2=0x7f049c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c004e60 0x7f049c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.901+0000 7f04b8c7a640 1 -- 172.21.15.113:0/3392669782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c003520 con 0x7f049c0039e0 2024-02-26T12:19:24.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f049c0039e0 0x7f049c003e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c190 tx=0x7f049c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92228b25eb330c6d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7f04b947b640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c004e60 0x7f049c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:24.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7efe6b220640 1 -- start start 2024-02-26T12:19:24.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff319d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 0x7ff31c0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff31ad9d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff319d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 0x7ff31c0cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48226/0 (socket says 172.21.15.113:48226) 2024-02-26T12:19:24.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.902+0000 7ff319d9b640 1 -- 172.21.15.113:0/3705911335 learned_addr learned my addr 172.21.15.113:0/3705911335 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f3592e88640 1 Processor -- start 2024-02-26T12:19:24.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7fb20762d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2000cf600 0x7fb2000ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f1175876640 1 Processor -- start 2024-02-26T12:19:24.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7fb20762d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 0x7fb2000cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f1175876640 1 -- start start 2024-02-26T12:19:24.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f3592e88640 1 -- start start 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7fb2053c9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2000cf600 0x7fb2000ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb2053c9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2000cf600 0x7fb2000ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48234/0 (socket says 172.21.15.113:48234) 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb2053c9640 1 -- 172.21.15.113:0/2651085141 learned_addr learned my addr 172.21.15.113:0/2651085141 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb20762d640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 0x7fb200159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20015d7b0 con 0x7fb200071290 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20015da90 con 0x7fb2000cf600 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015dd70 con 0x7fb2000cff20 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7ff31959a640 1 -- 172.21.15.113:0/3705911335 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587959437 0 0) 0x7ff31c0cd190 con 0x7ff31c0c3760 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7ff31ad9d640 1 -- 172.21.15.113:0/3705911335 >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 msgr2=0x7ff31c0cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/3705911335 >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 0x7ff31c0cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7ff31ad9d640 1 -- 172.21.15.113:0/3705911335 >> v1:172.21.15.152:6789/0 conn(0x7ff31c0c3760 legacy=0x7ff31c0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7ff31ad9d640 1 -- 172.21.15.113:0/3705911335 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0cda30 con 0x7ff31c06ed20 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7efe6b220640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 0x7efe640ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7efe6b220640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe640d04f0 0x7efe640d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7efe6b220640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640b70a0 con 0x7efe640b6c40 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7efe6b220640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe640d0ea0 con 0x7efe640d04f0 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7efe6b220640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b94d0 con 0x7efe6415df20 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe640d04f0 0x7efe640d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efe640d04f0 0x7efe640d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48242/0 (socket says 172.21.15.113:48242) 2024-02-26T12:19:24.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 -- 172.21.15.113:0/3539853408 learned_addr learned my addr 172.21.15.113:0/3539853408 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7fb1f1c14640 1 Processor -- start 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7fb1f1c14640 1 -- start start 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8007c60 con 0x7f049c0039e0 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.903+0000 7f04b37fe640 1 -- 172.21.15.113:0/3392669782 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8030070 con 0x7f049c0039e0 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe68fbc640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 0x7efe640ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 -- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 msgr2=0x7efe640ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f1175876640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f1175876640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f117006da30 0x7f117006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f1175876640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700b36c0 con 0x7f11700ced00 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 0x7efe640ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 -- 172.21.15.113:0/3539853408 >> v1:172.21.15.113:6789/0 conn(0x7efe640b6c40 legacy=0x7efe640d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f1175876640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117006d5e0 con 0x7f117006da30 2024-02-26T12:19:24.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f1175876640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b3f60 con 0x7f1170166220 2024-02-26T12:19:24.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f04baede640 1 -- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f049c0039e0 msgr2=0x7f049c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f04baede640 1 --2- 172.21.15.113:0/3392669782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f049c0039e0 0x7f049c003e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c190 tx=0x7f049c005830 comp rx=0 tx=0).stop 2024-02-26T12:19:24.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe697bd640 1 -- 172.21.15.113:0/3539853408 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640b9790 con 0x7efe640d04f0 2024-02-26T12:19:24.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f116e7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7efe68fbc640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 0x7efe640ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f04b947b640 1 -- 172.21.15.113:0/3392669782 reap_dead start 2024-02-26T12:19:24.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f116e7fc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55894/0 (socket says 172.21.15.113:55894) 2024-02-26T12:19:24.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f116e7fc640 1 -- 172.21.15.113:0/1659099083 learned_addr learned my addr 172.21.15.113:0/1659099083 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 0x7f358c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f358c159c90 0x7f358c0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c0b2d70 con 0x7f358c06b640 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c160b50 con 0x7f358c159c90 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3592e88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c06e810 con 0x7f358c15d890 2024-02-26T12:19:24.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3590c24640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb205bca640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 0x7fb200159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb2053c9640 1 -- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 msgr2=0x7fb200159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb2053c9640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 0x7fb200159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb2053c9640 1 -- 172.21.15.113:0/2651085141 >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 msgr2=0x7fb2000cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3b1c9db640 1 Processor -- start 2024-02-26T12:19:24.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3590c24640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55882/0 (socket says 172.21.15.113:55882) 2024-02-26T12:19:24.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3590c24640 1 -- 172.21.15.113:0/3358675569 learned_addr learned my addr 172.21.15.113:0/3358675569 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7fb204bc8640 1 --2- 172.21.15.113:0/2651085141 >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 0x7fb2000cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f04baede640 1 -- 172.21.15.113:0/3392669782 shutdown_connections 2024-02-26T12:19:24.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f04baede640 1 -- 172.21.15.113:0/3392669782 >> 172.21.15.113:0/3392669782 conn(0x7f04b4099a40 msgr2=0x7f04b40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3591425640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.152:3300/0 conn(0x7f358c159c90 0x7f358c0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f04baede640 1 -- 172.21.15.113:0/3392669782 shutdown_connections 2024-02-26T12:19:24.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f04baede640 1 -- 172.21.15.113:0/3392669782 wait complete. 2024-02-26T12:19:24.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f358bfff640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 0x7f358c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/3705911335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0cf560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0097a0 tx=0x7ff30c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee41e0809501dd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1659099083 >> v2:172.21.15.152:3300/0 conn(0x7f117006da30 0x7f117006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f116e7fc640 1 -- 172.21.15.113:0/1659099083 >> v2:172.21.15.152:3300/0 conn(0x7f117006da30 msgr2=0x7f117006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1659099083 >> v2:172.21.15.152:3300/0 conn(0x7f117006da30 0x7f117006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f116e7fc640 1 -- 172.21.15.113:0/1659099083 >> v1:172.21.15.113:6789/0 conn(0x7f11700ced00 legacy=0x7f1170163000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.904+0000 7f3b1c9db640 1 -- start start 2024-02-26T12:19:24.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f116e7fc640 1 -- 172.21.15.113:0/1659099083 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b39a0 con 0x7f1170166220 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7ff31959a640 1 -- 172.21.15.113:0/3705911335 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c035020 con 0x7ff31c06ed20 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7ff31959a640 1 -- 172.21.15.113:0/3705911335 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c031810 con 0x7ff31c06ed20 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7ff31959a640 1 -- 172.21.15.113:0/3705911335 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c031be0 con 0x7ff31c06ed20 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f1c14640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1e40501a0 0x7fb1e4038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f0c12640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb1e40df220 0x7fb1e404fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57976/0 (socket says 172.21.15.113:57976) 2024-02-26T12:19:24.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f1c14640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f1c14640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e40544c0 con 0x7fb1e40df220 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f1c14640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40541e0 con 0x7fb1e40501a0 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1f1c14640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4005f30 con 0x7fb1e4053c70 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1ebfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1e40501a0 0x7fb1e4038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1ebfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb1e40501a0 0x7fb1e4038080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48274/0 (socket says 172.21.15.113:48274) 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb1ebfff640 1 -- 172.21.15.113:0/1071156594 learned_addr learned my addr 172.21.15.113:0/1071156594 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1c9db640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3b18066a00 0x7f3b18159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb2053c9640 1 --2- 172.21.15.113:0/2651085141 >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 0x7fb2000cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7fb2053c9640 1 -- 172.21.15.113:0/2651085141 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20015e050 con 0x7fb2000cf600 2024-02-26T12:19:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb204bc8640 1 --2- 172.21.15.113:0/2651085141 >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 0x7fb2000cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1c9db640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b180cf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7efe697bd640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640d04f0 0x7efe640d0960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe19d03c2908fdc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1c9db640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180ce6a0 con 0x7f3b180cf8c0 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1c9db640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b18160d70 con 0x7f3b18066a00 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f3590c24640 1 -- 172.21.15.113:0/3358675569 >> v2:172.21.15.152:3300/0 conn(0x7f358c159c90 msgr2=0x7f358c0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f3590c24640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.152:3300/0 conn(0x7f358c159c90 0x7f358c0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f3590c24640 1 -- 172.21.15.113:0/3358675569 >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 msgr2=0x7f358c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f3590c24640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 0x7f358c159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.905+0000 7f3590c24640 1 -- 172.21.15.113:0/3358675569 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c06eaf0 con 0x7f358c15d890 2024-02-26T12:19:24.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb205bca640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 0x7fb200159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f358bfff640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 0x7f358c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1c9db640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180ce940 con 0x7f3b18066de0 2024-02-26T12:19:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 -- 172.21.15.113:0/3705911335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 msgr2=0x7ff31c0cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 --2- 172.21.15.113:0/3705911335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0cf560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0097a0 tx=0x7ff30c02b8b0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1759e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3b180cf8c0 0x7f3b180ca570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57988/0 (socket says 172.21.15.113:57988) 2024-02-26T12:19:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb1ebfff640 1 -- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 msgr2=0x7fb1e4006a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-26T12:19:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb1ebfff640 1 --2- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4006a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb1ebfff640 1 -- 172.21.15.113:0/1071156594 >> v1:172.21.15.113:6789/0 conn(0x7fb1e40df220 legacy=0x7fb1e404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb1ebfff640 1 -- 172.21.15.113:0/1071156594 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4006210 con 0x7fb1e40501a0 2024-02-26T12:19:24.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3590c24640 1 --2- 172.21.15.113:0/3358675569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f358c0aebe0 tx=0x7f357402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d5786e2e56755c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1759e640 1 -- 172.21.15.113:0/3049688706 learned_addr learned my addr 172.21.15.113:0/3049688706 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:24.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7efe637fe640 1 -- 172.21.15.113:0/3539853408 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58034070 con 0x7efe640d04f0 2024-02-26T12:19:24.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b1659c640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b180cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7efe637fe640 1 -- 172.21.15.113:0/3539853408 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58030860 con 0x7efe640d04f0 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 -- 172.21.15.113:0/3705911335 shutdown_connections 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 --2- 172.21.15.113:0/3705911335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0cf560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 --2- 172.21.15.113:0/3705911335 >> v2:172.21.15.152:3300/0 conn(0x7ff31c0cdf50 0x7ff31c0cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 -- 172.21.15.113:0/3705911335 >> 172.21.15.113:0/3705911335 conn(0x7ff31c0d0790 msgr2=0x7ff31c0d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.911 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3049688706 >> v2:172.21.15.113:3300/0 conn(0x7f3b18066a00 0x7f3b18159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7ff320a36640 1 -- 172.21.15.113:0/3705911335 shutdown_connections 2024-02-26T12:19:24.912 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.906+0000 7fb2053c9640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2000cf600 0x7fb2000ccba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b4de0 tx=0x7fb1fc02ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31ff92bc3c2a1b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f04baede640 1 Processor -- start 2024-02-26T12:19:24.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe637fe640 1 -- 172.21.15.113:0/3539853408 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58030c70 con 0x7efe640d04f0 2024-02-26T12:19:24.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7ff320a36640 1 -- 172.21.15.113:0/3705911335 wait complete. 2024-02-26T12:19:24.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f358b7fe640 1 -- 172.21.15.113:0/3358675569 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574034070 con 0x7f358c15d890 2024-02-26T12:19:24.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f04baede640 1 -- start start 2024-02-26T12:19:24.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7fb1f7fff640 1 -- 172.21.15.113:0/2651085141 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc034070 con 0x7fb2000cf600 2024-02-26T12:19:24.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f358b7fe640 1 -- 172.21.15.113:0/3358675569 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574030800 con 0x7f358c15d890 2024-02-26T12:19:24.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b15d9b640 1 -- 172.21.15.113:0/3049688706 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552608822 0 0) 0x7f3b180ce6a0 con 0x7f3b180cf8c0 2024-02-26T12:19:24.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b15d9b640 1 -- 172.21.15.113:0/3049688706 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00003520 con 0x7f3b180cf8c0 2024-02-26T12:19:24.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f358b7fe640 1 -- 172.21.15.113:0/3358675569 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574030bd0 con 0x7f358c15d890 2024-02-26T12:19:24.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7fb1f7fff640 1 -- 172.21.15.113:0/2651085141 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc008df0 con 0x7fb2000cf600 2024-02-26T12:19:24.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7fb1f7fff640 1 -- 172.21.15.113:0/2651085141 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00a2f0 con 0x7fb2000cf600 2024-02-26T12:19:24.918 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7fb1ebfff640 1 --2- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e4038080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80091e0 tx=0x7fb1d802cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be4f26db03c61cb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 -- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640d04f0 msgr2=0x7efe640d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640d04f0 0x7efe640d0960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe58009870 tx=0x7efe5802b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1659099083 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f116802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e93a22822a85cb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 -- 172.21.15.113:0/3539853408 shutdown_connections 2024-02-26T12:19:24.919 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640d04f0 0x7efe640d0960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 --2- 172.21.15.113:0/3539853408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe6415df20 0x7efe640ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f116dffb640 1 -- 172.21.15.113:0/1659099083 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116802c9f0 con 0x7f1170166220 2024-02-26T12:19:24.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7efe6b220640 1 -- 172.21.15.113:0/3539853408 >> 172.21.15.113:0/3539853408 conn(0x7efe64072940 msgr2=0x7efe640b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f116dffb640 1 -- 172.21.15.113:0/1659099083 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116802cb90 con 0x7f1170166220 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f116dffb640 1 -- 172.21.15.113:0/1659099083 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680343f0 con 0x7f1170166220 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b16d9d640 1 -- 172.21.15.113:0/3049688706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 msgr2=0x7f3b180cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b180cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b16d9d640 1 -- 172.21.15.113:0/3049688706 >> v1:172.21.15.113:6789/0 conn(0x7f3b180cf8c0 legacy=0x7f3b180ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.907+0000 7f3b16d9d640 1 -- 172.21.15.113:0/3049688706 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180cec20 con 0x7f3b18066a00 2024-02-26T12:19:24.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 -- 172.21.15.113:0/3358675569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 msgr2=0x7f358c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 --2- 172.21.15.113:0/3358675569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f358c0aebe0 tx=0x7f357402b940 comp rx=0 tx=0).stop 2024-02-26T12:19:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 0x7f04b40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2000cf600 msgr2=0x7fb2000ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2000cf600 0x7fb2000ccba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2000b4de0 tx=0x7fb1fc02ca30 comp rx=0 tx=0).stop 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 -- 172.21.15.113:0/3358675569 shutdown_connections 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.152:3300/0 conn(0x7f358c159c90 0x7f358c0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 --2- 172.21.15.113:0/3358675569 >> v2:172.21.15.113:3300/0 conn(0x7f358c06b640 0x7f358c159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 --2- 172.21.15.113:0/3358675569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c15d890 0x7f358c06dc00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 -- 172.21.15.113:0/3358675569 >> 172.21.15.113:0/3358675569 conn(0x7f358c06ab50 msgr2=0x7f358c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb1eb7fe640 1 -- 172.21.15.113:0/1071156594 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d803a070 con 0x7fb1e40501a0 2024-02-26T12:19:24.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb1eb7fe640 1 -- 172.21.15.113:0/1071156594 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d802d950 con 0x7fb1e40501a0 2024-02-26T12:19:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 shutdown_connections 2024-02-26T12:19:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cff20 0x7fb200159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04b8c7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 0x7f04b40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04b8c7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 0x7f04b40c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38300/0 (socket says 172.21.15.113:38300) 2024-02-26T12:19:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 --2- 172.21.15.113:0/2651085141 >> v2:172.21.15.113:3300/0 conn(0x7fb200071290 0x7fb2000cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb1eb7fe640 1 -- 172.21.15.113:0/1071156594 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d802dd20 con 0x7fb1e40501a0 2024-02-26T12:19:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 --2- 172.21.15.113:0/2651085141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2000cf600 0x7fb2000ccba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04b414f190 0x7f04b413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 >> 172.21.15.113:0/2651085141 conn(0x7fb20006ab50 msgr2=0x7fb20006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b413e570 0x7f04b4160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40c3c90 con 0x7f049c0039e0 2024-02-26T12:19:24.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7ff320a36640 1 Processor -- start 2024-02-26T12:19:24.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f3592e88640 1 -- 172.21.15.113:0/3358675569 shutdown_connections 2024-02-26T12:19:24.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 shutdown_connections 2024-02-26T12:19:24.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7fb20762d640 1 -- 172.21.15.113:0/2651085141 wait complete. 2024-02-26T12:19:24.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f1175876640 1 -- 172.21.15.113:0/1659099083 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 msgr2=0x7f1170166690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f1175876640 1 --2- 172.21.15.113:0/1659099083 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f116802be50 comp rx=0 tx=0).stop 2024-02-26T12:19:24.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b41625e0 con 0x7f04b414f190 2024-02-26T12:19:24.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04baede640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b40c3e10 con 0x7f04b413e570 2024-02-26T12:19:24.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7f04b8c7a640 1 -- 172.21.15.113:0/1027604719 learned_addr learned my addr 172.21.15.113:0/1027604719 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 -- 172.21.15.113:0/1659099083 shutdown_connections 2024-02-26T12:19:24.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b3fff640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04b414f190 0x7f04b413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f3592e88640 1 -- 172.21.15.113:0/3358675569 wait complete. 2024-02-26T12:19:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 --2- 172.21.15.113:0/1659099083 >> v2:172.21.15.152:3300/0 conn(0x7f117006da30 0x7f117006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 --2- 172.21.15.113:0/1659099083 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1170166220 0x7f1170166690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 -- 172.21.15.113:0/1659099083 >> 172.21.15.113:0/1659099083 conn(0x7f117006ab50 msgr2=0x7f117006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7efe6b220640 1 -- 172.21.15.113:0/3539853408 shutdown_connections 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 -- 172.21.15.113:0/1659099083 shutdown_connections 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7efe6b220640 1 -- 172.21.15.113:0/3539853408 wait complete. 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7fb1f1c14640 1 -- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 msgr2=0x7fb1e4038080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e4038080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80091e0 tx=0x7fb1d802cba0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 -- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b413e570 msgr2=0x7f04b4160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f04b413e570 0x7f04b4160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 -- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04b414f190 msgr2=0x7f04b413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04b414f190 0x7f04b413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b40c72b0 con 0x7f049c0039e0 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b3fff640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f04b414f190 0x7f04b413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f04b8c7a640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 0x7f04b40c63a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c190 tx=0x7f04a8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.909+0000 7f1175876640 1 -- 172.21.15.113:0/1659099083 wait complete. 2024-02-26T12:19:24.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.908+0000 7ff320a36640 1 -- start start 2024-02-26T12:19:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b18159de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1b6b1b5dc3d5c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8007c60 con 0x7f049c0039e0 2024-02-26T12:19:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b40c6a10 con 0x7f049c0039e0 2024-02-26T12:19:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b40c6fd0 con 0x7f049c0039e0 2024-02-26T12:19:24.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f3b15d9b640 1 -- 172.21.15.113:0/3049688706 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08035020 con 0x7f3b18066a00 2024-02-26T12:19:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f3b15d9b640 1 -- 172.21.15.113:0/3049688706 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08031810 con 0x7f3b18066a00 2024-02-26T12:19:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f3b15d9b640 1 -- 172.21.15.113:0/3049688706 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08031be0 con 0x7f3b18066a00 2024-02-26T12:19:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7f3592e88640 1 Processor -- start 2024-02-26T12:19:24.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb20762d640 1 Processor -- start 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31c0c3760 0x7ff31c0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff31c0c7da0 0x7ff31c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c06e860 con 0x7ff31c0c7da0 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c06e6e0 con 0x7ff31c0c3760 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff320a36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0d12b0 con 0x7ff31c06ed20 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55930/0 (socket says 172.21.15.113:55930) 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 -- 172.21.15.113:0/4240895566 learned_addr learned my addr 172.21.15.113:0/4240895566 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff31c0c7da0 0x7ff31c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 -- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31c0c3760 msgr2=0x7ff31c0c7860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-26T12:19:24.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff319d9b640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31c0c3760 0x7ff31c0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff31c0c3760 0x7ff31c0c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 -- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff31c0c7da0 msgr2=0x7ff31c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff31c0c7da0 0x7ff31c0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31a59c640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0c8320 con 0x7ff31c06ed20 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.910+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff31c0c7da0 0x7ff31c0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7ff31a59c640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0c93c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff314007fd0 tx=0x7ff31400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7efe6b220640 1 Processor -- start 2024-02-26T12:19:24.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f1175876640 1 Processor -- start 2024-02-26T12:19:24.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f3592e88640 1 -- start start 2024-02-26T12:19:24.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7efe6b220640 1 -- start start 2024-02-26T12:19:24.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8045070 con 0x7f049c0039e0 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3049688706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 msgr2=0x7f3b18159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f3b1c9db640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b18159de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b8b0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb20762d640 1 -- start start 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7f1175876640 1 -- start start 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314003970 con 0x7ff31c06ed20 2024-02-26T12:19:24.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c0c8600 con 0x7ff31c06ed20 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3049688706 shutdown_connections 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b180cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 --2- 172.21.15.113:0/3049688706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b18159de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314003b10 con 0x7ff31c06ed20 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31400a850 con 0x7ff31c06ed20 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c0c8bc0 con 0x7ff31c06ed20 2024-02-26T12:19:24.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3049688706 >> 172.21.15.113:0/3049688706 conn(0x7f3b180cc9a0 msgr2=0x7f3b180ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb1f1c14640 1 -- 172.21.15.113:0/1071156594 shutdown_connections 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/1071156594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e4038080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.911+0000 7fb1f1c14640 1 -- 172.21.15.113:0/1071156594 >> 172.21.15.113:0/1071156594 conn(0x7fb1e4009fb0 msgr2=0x7fb1e400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 0x7f358c148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8007490 con 0x7f049c0039e0 2024-02-26T12:19:24.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04b40c4e60 con 0x7f049c0039e0 2024-02-26T12:19:24.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f358c159c90 0x7f358c160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3049688706 shutdown_connections 2024-02-26T12:19:24.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7efe6b220640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 0x7efe640cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3590c24640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 0x7f358c148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3590c24640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 0x7f358c148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55934/0 (socket says 172.21.15.113:55934) 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f358c15d890 0x7f358c14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c06e2c0 con 0x7f358c15d890 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3590c24640 1 -- 172.21.15.113:0/1899142298 learned_addr learned my addr 172.21.15.113:0/1899142298 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c06e140 con 0x7f358c159c90 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0ccb10 con 0x7f358c06b640 2024-02-26T12:19:24.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f1175876640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f117006da30 0x7f117015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7fb20762d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb200071290 0x7fb2001468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7fb1f1c14640 1 -- 172.21.15.113:0/1071156594 shutdown_connections 2024-02-26T12:19:24.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe6b220640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe640d04f0 0x7efe64158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04a8040470 con 0x7f049c0039e0 2024-02-26T12:19:24.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb20762d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 0x7fb20014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe6b220640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640c9680 0x7efe640c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f358bfff640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f358c159c90 0x7f358c160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3591425640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f358c15d890 0x7f358c14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb20762d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2000cff20 0x7fb20014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f1175876640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 0x7f11701542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f1175876640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170166220 0x7f11700cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f1175876640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b3270 con 0x7f1170166220 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f1175876640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170165d00 con 0x7f11700ced00 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f1175876640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b33f0 con 0x7f117006da30 2024-02-26T12:19:24.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f116e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 0x7f11701542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f116e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 0x7f11701542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48328/0 (socket says 172.21.15.113:48328) 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f116e7fc640 1 -- 172.21.15.113:0/1829743335 learned_addr learned my addr 172.21.15.113:0/1829743335 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170166220 0x7f11700cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f116effd640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f117006da30 0x7f117015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3590c24640 1 -- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f358c159c90 msgr2=0x7f358c160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3590c24640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f358c159c90 0x7f358c160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3590c24640 1 -- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f358c15d890 msgr2=0x7f358c14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3590c24640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f358c15d890 0x7f358c14b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3590c24640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c13f140 con 0x7f358c06b640 2024-02-26T12:19:24.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f3591425640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f358c15d890 0x7f358c14b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f3590c24640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 0x7f358c148900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3574009960 tx=0x7f35740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb204bc8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 0x7fb20014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb204bc8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 0x7fb20014e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55942/0 (socket says 172.21.15.113:55942) 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb204bc8640 1 -- 172.21.15.113:0/3908659801 learned_addr learned my addr 172.21.15.113:0/3908659801 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006f380 con 0x7fb2000cff20 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20015e610 con 0x7fb200071290 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20006f500 con 0x7fb2000cf600 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb205bca640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2000cff20 0x7fb20014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7fb204bc8640 1 -- 172.21.15.113:0/3908659801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb200071290 msgr2=0x7fb2001468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7fb204bc8640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb200071290 0x7fb2001468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff31400a9f0 con 0x7ff31c06ed20 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff300001030 con 0x7ff31c06ed20 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7fb1f1c14640 1 -- 172.21.15.113:0/1071156594 wait complete. 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f04b17fa640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f04a006b550 0x7f04a006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a80ac190 con 0x7f049c0039e0 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f04b17fa640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f04a00737d0 0x7f04a0075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04a00762a0 con 0x7f04a00737d0 2024-02-26T12:19:24.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04a80b3050 con 0x7f049c0039e0 2024-02-26T12:19:24.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f04b947b640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f04a00737d0 0x7f04a0075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7fb204bc8640 1 -- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2000cff20 msgr2=0x7fb20014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7fb204bc8640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2000cff20 0x7fb20014f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7fb204bc8640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20014e9b0 con 0x7fb2000cf600 2024-02-26T12:19:24.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe68fbc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 0x7efe640cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe68fbc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 0x7efe640cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38340/0 (socket says 172.21.15.113:38340) 2024-02-26T12:19:24.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe63fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe640d04f0 0x7efe64158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f04b947b640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f04a00737d0 0x7f04a0075bf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f116e7fc640 1 -- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f117006da30 msgr2=0x7f117015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f04b3fff640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f04a006b550 0x7f04a006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f117006da30 0x7f117015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7ff30affd640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff2fc06b550 0x7ff2fc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574034040 con 0x7f358c06b640 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574030e30 con 0x7f358c06b640 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740433f0 con 0x7f358c06b640 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f116e7fc640 1 -- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170166220 msgr2=0x7f11700cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1170166220 0x7f11700cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7f116e7fc640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11701593d0 con 0x7f11700ced00 2024-02-26T12:19:24.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.912+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3049688706 wait complete. 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.913+0000 7efe63fff640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe640d04f0 0x7efe64158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55936/0 (socket says 172.21.15.113:55936) 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7efe68fbc640 1 -- 172.21.15.113:0/1830955562 learned_addr learned my addr 172.21.15.113:0/1830955562 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640cf150 con 0x7efe640b6c40 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640d1780 con 0x7efe640c9680 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe697bd640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640c9680 0x7efe640c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f3b1c9db640 1 Processor -- start 2024-02-26T12:19:24.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640cf2d0 con 0x7efe640d04f0 2024-02-26T12:19:24.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f3b1c9db640 1 -- start start 2024-02-26T12:19:24.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb204bc8640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 0x7fb20014e0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c7f0 tx=0x7fb1f000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff31409b080 con 0x7ff31c06ed20 2024-02-26T12:19:24.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.914+0000 7ff30affd640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7ff2fc073770 0x7ff2fc075b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff31402ee70 con 0x7ff2fc073770 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3140a2050 con 0x7ff31c06ed20 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7ff319d9b640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff2fc06b550 0x7ff2fc06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7ff2fc073770 0x7ff2fc075b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb1f1c14640 1 Processor -- start 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb1f1c14640 1 -- start start 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f04b3fff640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f04a006b550 0x7f04a006da10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04b415fc00 tx=0x7f04a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== osd.7 v2:172.21.15.152:6808/276006357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f04a00762a0 con 0x7f04a00737d0 2024-02-26T12:19:24.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0015070 con 0x7fb2000cf600 2024-02-26T12:19:24.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0007a30 con 0x7fb2000cf600 2024-02-26T12:19:24.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0007e00 con 0x7fb2000cf600 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe68fbc640 1 -- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe640d04f0 msgr2=0x7efe64158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe68fbc640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efe640d04f0 0x7efe64158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe68fbc640 1 -- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640c9680 msgr2=0x7efe640c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe68fbc640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efe640c9680 0x7efe640c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7ff319d9b640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff2fc06b550 0x7ff2fc06da10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff31c165290 tx=0x7ff310008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7efe68fbc640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640cd9c0 con 0x7efe640b6c40 2024-02-26T12:19:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c13f420 con 0x7f358c06b640 2024-02-26T12:19:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c13f9e0 con 0x7f358c06b640 2024-02-26T12:19:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20014ec90 con 0x7fb2000cf600 2024-02-26T12:19:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.915+0000 7f116e7fc640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 0x7f11701542b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f1168004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe68fbc640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 0x7efe640cd480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c820 tx=0x7efe5400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20014f250 con 0x7fb2000cf600 2024-02-26T12:19:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54015070 con 0x7efe640b6c40 2024-02-26T12:19:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54007a30 con 0x7efe640b6c40 2024-02-26T12:19:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54007de0 con 0x7efe640b6c40 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b180c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b182016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180cf8c0 0x7f3b180a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cb330 con 0x7f3b18066a00 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1806abf0 con 0x7f3b180cf8c0 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1c9db640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1815a320 con 0x7f3b18066de0 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180cf8c0 0x7f3b180a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180cf8c0 0x7f3b180a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48344/0 (socket says 172.21.15.113:48344) 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b1759e640 1 -- 172.21.15.113:0/3577943380 learned_addr learned my addr 172.21.15.113:0/3577943380 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7fb1f1c14640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e40485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168044020 con 0x7f11700ced00 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1168040690 con 0x7f11700ced00 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b180c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b182016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 -- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180cf8c0 msgr2=0x7f3b180a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180cf8c0 0x7f3b180a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 -- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 msgr2=0x7f3b180c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3b18066a00 0x7f3b180c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180c5550 con 0x7f3b18066de0 2024-02-26T12:19:24.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3b1659c640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b182016f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00e850 tx=0x7f3b0c00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f358c074a50 con 0x7f358c06b640 2024-02-26T12:19:24.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb20014f630 con 0x7fb2000cf600 2024-02-26T12:19:24.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7ff31ad9d640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7ff2fc073770 0x7ff2fc075b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640cb5f0 con 0x7efe640b6c40 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.916+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640cbbb0 con 0x7efe640b6c40 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb1f1c14640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4047a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb1f1c14640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1e40df220 0x7fb1e404d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb1f1c14640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4037a90 con 0x7fb1e40df220 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb1f1c14640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4037910 con 0x7fb1e40501a0 2024-02-26T12:19:24.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7fb1f1c14640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40df600 con 0x7fb1e4053c70 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168040a80 con 0x7f11700ced00 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c017070 con 0x7f3b18066de0 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.917+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00c940 con 0x7f3b18066de0 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c017070 con 0x7f3b18066de0 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b180c5830 con 0x7f3b18066de0 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18200420 con 0x7f3b18066de0 2024-02-26T12:19:24.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170159640 con 0x7f11700ced00 2024-02-26T12:19:24.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe640cc4e0 con 0x7efe640b6c40 2024-02-26T12:19:24.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170159c00 con 0x7f11700ced00 2024-02-26T12:19:24.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7fb1f1413640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1e40df220 0x7fb1e404d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7fb1f1413640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1e40df220 0x7fb1e404d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38368/0 (socket says 172.21.15.113:38368) 2024-02-26T12:19:24.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7fb1f1413640 1 -- 172.21.15.113:0/3762885026 learned_addr learned my addr 172.21.15.113:0/3762885026 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:24.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== osd.4 v2:172.21.15.152:6816/1514413955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff31402ee70 con 0x7ff2fc073770 2024-02-26T12:19:24.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.918+0000 7fb1f0c12640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e40485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1ebfff640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4047a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3574037070 con 0x7f358c06b640 2024-02-26T12:19:24.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1170074a50 con 0x7f11700ced00 2024-02-26T12:19:24.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b18200230 con 0x7f3b18066de0 2024-02-26T12:19:24.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1f0018070 con 0x7fb2000cf600 2024-02-26T12:19:24.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f5ffb640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1e406b5a0 0x7fb1e406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb2053c9640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1e406b5a0 0x7fb1e406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1f008aac0 con 0x7fb2000cf600 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7fb1f5ffb640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7fb1e4073820 0x7fb1e4075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe54018070 con 0x7efe640b6c40 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f0c12640 1 -- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 msgr2=0x7fb1e4047a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f0c12640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb1e4053c70 0x7fb1e4047a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f0c12640 1 -- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1e40df220 msgr2=0x7fb1e404d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f0c12640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb1e40df220 0x7fb1e404d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7fb1f0c12640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4048b30 con 0x7fb1e40501a0 2024-02-26T12:19:24.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f356c06b5a0 0x7f356c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1f000bfa0 con 0x7fb1e4073820 2024-02-26T12:19:24.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f008aeb0 con 0x7fb2000cf600 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35740ace60 con 0x7f358c06b640 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7f356c073820 0x7f356c075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3574044ec0 con 0x7f356c073820 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.919+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35740ad250 con 0x7f358c06b640 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7f3591425640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7f356c073820 0x7f356c075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1168069070 con 0x7f11700ced00 2024-02-26T12:19:24.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b0c01a070 con 0x7f3b18066de0 2024-02-26T12:19:24.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7fb205bca640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7fb1e4073820 0x7fb1e4075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7f3591425640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7f356c073820 0x7f356c075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe617fa640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efe5006b5d0 0x7efe5006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe5408a070 con 0x7efe640b6c40 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe617fa640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7efe500737f0 0x7efe50075c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe5401ce50 con 0x7efe500737f0 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe54091050 con 0x7efe640b6c40 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.920+0000 7efe63fff640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efe5006b5d0 0x7efe5006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f1157fff640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f115c06b5a0 0x7f115c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f358bfff640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f356c06b5a0 0x7f356c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7fb2053c9640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1e406b5a0 0x7fb1e406da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc036000 tx=0x7fb1fc031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7fb205bca640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7fb1e4073820 0x7fb1e4075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7efe697bd640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7efe500737f0 0x7efe50075c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7fb1f0c12640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e40485f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c390 tx=0x7fb1e000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3aff7fe640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3b0406b6d0 0x7f3b0406db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b0c08a1a0 con 0x7f3b18066de0 2024-02-26T12:19:24.973 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f116effd640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f115c06b5a0 0x7f115c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3aff7fe640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7f3b040738d0 0x7f3b04075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b040763a0 con 0x7f3b040738d0 2024-02-26T12:19:24.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b0c091050 con 0x7f3b18066de0 2024-02-26T12:19:24.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7efe697bd640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7efe500737f0 0x7efe50075c10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11680ad860 con 0x7f11700ced00 2024-02-26T12:19:24.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3b0406b6d0 0x7f3b0406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== osd.2 v2:172.21.15.113:6816/1378425100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3574044ec0 con 0x7f356c073820 2024-02-26T12:19:24.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f1157fff640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f115c073820 0x7f115c075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f116803ce50 con 0x7f115c073820 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.921+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00074e0 con 0x7fb1e40501a0 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0015030 con 0x7fb1e40501a0 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0005a30 con 0x7fb1e40501a0 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e4047f60 con 0x7fb1e40501a0 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e4176340 con 0x7fb1e40501a0 2024-02-26T12:19:24.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f3b1759e640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7f3b040738d0 0x7f3b04075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f3b16d9d640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3b0406b6d0 0x7f3b0406db90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b08036000 tx=0x7f3b0803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.923+0000 7f3b1759e640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7f3b040738d0 0x7f3b04075cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f116effd640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f115c06b5a0 0x7f115c06da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11640011f0 tx=0x7f1164001180 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f115c073820 0x7f115c075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.923+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11680adc50 con 0x7f11700ced00 2024-02-26T12:19:24.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.923+0000 7f116f7fe640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f115c073820 0x7f115c075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== osd.3 v2:172.21.15.113:6800/3789965285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1f000bfa0 con 0x7fb1e4073820 2024-02-26T12:19:24.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7efe63fff640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efe5006b5d0 0x7efe5006da90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe641f7000 tx=0x7efe5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.923+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== osd.5 v2:172.21.15.152:6824/237296747 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efe5401ce50 con 0x7efe500737f0 2024-02-26T12:19:24.978 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== osd.0 v2:172.21.15.113:6824/228866961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f116803ce50 con 0x7f115c073820 2024-02-26T12:19:24.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== osd.1 v2:172.21.15.113:6808/1831062802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3b040763a0 con 0x7f3b040738d0 2024-02-26T12:19:24.979 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.922+0000 7f358bfff640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f356c06b5a0 0x7f356c06da60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3584007690 tx=0x7f3584007620 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.923+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1cc001030 con 0x7fb1e40501a0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb1e0005bd0 con 0x7fb1e40501a0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1d006b5a0 0x7fb1d006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1e0089200 con 0x7fb1e40501a0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fb1d00737c0 0x7fb1d0075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1e0007680 con 0x7fb1d00737c0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.924+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1e0090050 con 0x7fb1e40501a0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.925+0000 7fb1ebfff640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1d006b5a0 0x7fb1d006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.925+0000 7fb1f1413640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fb1d00737c0 0x7fb1d0075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.925+0000 7fb1ebfff640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1d006b5a0 0x7fb1d006da60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8037000 tx=0x7fb1d8031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.926+0000 7fb1f1413640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fb1d00737c0 0x7fb1d0075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:24.980 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.926+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== osd.6 v2:172.21.15.152:6800/4099407341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1e0007680 con 0x7fb1d00737c0 2024-02-26T12:19:24.981 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.949+0000 7f3b1c9db640 1 -- 172.21.15.113:0/3577943380 --> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b1804f030 con 0x7f3b040738d0 2024-02-26T12:19:24.981 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.949+0000 7f3aff7fe640 1 -- 172.21.15.113:0/3577943380 <== osd.1 v2:172.21.15.113:6808/1831062802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b1804f030 con 0x7f3b040738d0 2024-02-26T12:19:24.981 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 --> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04b4068180 con 0x7f04a00737d0 2024-02-26T12:19:24.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7f3b040738d0 msgr2=0x7f3b04075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7f3b040738d0 0x7f3b04075cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3b0406b6d0 msgr2=0x7f3b0406db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.982 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3b0406b6d0 0x7f3b0406db90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b08036000 tx=0x7f3b0803c040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 msgr2=0x7f3b182016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 --2- 172.21.15.113:0/3577943380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b18066de0 0x7f3b182016f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00e850 tx=0x7f3b0c00ed10 comp rx=0 tx=0).stop 2024-02-26T12:19:24.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.951+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 --> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff300002dd0 con 0x7ff2fc073770 2024-02-26T12:19:24.983 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3b1759e640 1 -- 172.21.15.113:0/3577943380 reap_dead start 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 shutdown_connections 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.950+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 >> 172.21.15.113:0/3577943380 conn(0x7f3b180cc9a0 msgr2=0x7f3b1806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.951+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 shutdown_connections 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.951+0000 7f3afd7fa640 1 -- 172.21.15.113:0/3577943380 wait complete. 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.951+0000 7ff30affd640 1 -- 172.21.15.113:0/4240895566 <== osd.4 v2:172.21.15.152:6816/1514413955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff300002dd0 con 0x7ff2fc073770 2024-02-26T12:19:24.984 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.951+0000 7f04b17fa640 1 -- 172.21.15.113:0/1027604719 <== osd.7 v2:172.21.15.152:6808/276006357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04b4068180 con 0x7f04a00737d0 2024-02-26T12:19:24.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f04a00737d0 msgr2=0x7f04a0075bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f04a00737d0 0x7f04a0075bf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.985 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f04a006b550 msgr2=0x7f04a006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f04a006b550 0x7f04a006da10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04b415fc00 tx=0x7f04a4009040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 msgr2=0x7f04b40c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 --2- 172.21.15.113:0/1027604719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f049c0039e0 0x7f04b40c63a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c190 tx=0x7f04a8001970 comp rx=0 tx=0).stop 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04b947b640 1 -- 172.21.15.113:0/1027604719 reap_dead start 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 shutdown_connections 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 >> 172.21.15.113:0/1027604719 conn(0x7f04b4099a40 msgr2=0x7f04b40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 shutdown_connections 2024-02-26T12:19:24.986 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.952+0000 7f04baede640 1 -- 172.21.15.113:0/1027604719 wait complete. 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7ff2fc073770 msgr2=0x7ff2fc075b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7ff2fc073770 0x7ff2fc075b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff2fc06b550 msgr2=0x7ff2fc06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff2fc06b550 0x7ff2fc06da10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff31c165290 tx=0x7ff310008040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 msgr2=0x7ff31c0c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 --2- 172.21.15.113:0/4240895566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff31c06ed20 0x7ff31c0c93c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff314007fd0 tx=0x7ff31400cc70 comp rx=0 tx=0).stop 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff31ad9d640 1 -- 172.21.15.113:0/4240895566 reap_dead start 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 shutdown_connections 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.953+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 >> 172.21.15.113:0/4240895566 conn(0x7ff31c0d0790 msgr2=0x7ff31c0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.954+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 shutdown_connections 2024-02-26T12:19:24.988 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.954+0000 7ff320a36640 1 -- 172.21.15.113:0/4240895566 wait complete. 2024-02-26T12:19:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.954+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 --> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f358c074a50 con 0x7f356c073820 2024-02-26T12:19:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.955+0000 7f35897fa640 1 -- 172.21.15.113:0/1899142298 <== osd.2 v2:172.21.15.113:6816/1378425100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f358c074a50 con 0x7f356c073820 2024-02-26T12:19:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.955+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7f356c073820 msgr2=0x7f356c075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.989 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.955+0000 7f3592e88640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7f356c073820 0x7f356c075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.956+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 --> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe6415f4f0 con 0x7efe500737f0 2024-02-26T12:19:24.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f356c06b5a0 msgr2=0x7f356c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.990 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f356c06b5a0 0x7f356c06da60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3584007690 tx=0x7f3584007620 comp rx=0 tx=0).stop 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 msgr2=0x7f358c148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 --2- 172.21.15.113:0/1899142298 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f358c06b640 0x7f358c148900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3574009960 tx=0x7f35740046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3591425640 1 -- 172.21.15.113:0/1899142298 reap_dead start 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 shutdown_connections 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 >> 172.21.15.113:0/1899142298 conn(0x7f358c06ab50 msgr2=0x7f358c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7efe617fa640 1 -- 172.21.15.113:0/1830955562 <== osd.5 v2:172.21.15.152:6824/237296747 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe6415f4f0 con 0x7efe500737f0 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 shutdown_connections 2024-02-26T12:19:24.991 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7f3592e88640 1 -- 172.21.15.113:0/1899142298 wait complete. 2024-02-26T12:19:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.957+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 --> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb200074a50 con 0x7fb1e4073820 2024-02-26T12:19:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.958+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 --> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1cc002dd0 con 0x7fb1d00737c0 2024-02-26T12:19:24.992 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.958+0000 7fb1f5ffb640 1 -- 172.21.15.113:0/3908659801 <== osd.3 v2:172.21.15.113:6800/3789965285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb200074a50 con 0x7fb1e4073820 2024-02-26T12:19:24.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.958+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 --> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11700b46a0 con 0x7f115c073820 2024-02-26T12:19:24.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.958+0000 7fb1e97fa640 1 -- 172.21.15.113:0/3762885026 <== osd.6 v2:172.21.15.152:6800/4099407341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1cc002dd0 con 0x7fb1d00737c0 2024-02-26T12:19:24.993 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7fb1e4073820 msgr2=0x7fb1e4075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7fb1e4073820 0x7fb1e4075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7efe500737f0 msgr2=0x7efe50075c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7efe500737f0 0x7efe50075c10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fb1d00737c0 msgr2=0x7fb1d0075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fb1d00737c0 0x7fb1d0075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1e406b5a0 msgr2=0x7fb1e406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1e406b5a0 0x7fb1e406da60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc036000 tx=0x7fb1fc031000 comp rx=0 tx=0).stop 2024-02-26T12:19:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efe5006b5d0 msgr2=0x7efe5006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efe5006b5d0 0x7efe5006da90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe641f7000 tx=0x7efe5c009040 comp rx=0 tx=0).stop 2024-02-26T12:19:24.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 msgr2=0x7efe640cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe6b220640 1 --2- 172.21.15.113:0/1830955562 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe640b6c40 0x7efe640cd480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c820 tx=0x7efe5400cc20 comp rx=0 tx=0).stop 2024-02-26T12:19:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 msgr2=0x7fb20014e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7efe697bd640 1 -- 172.21.15.113:0/1830955562 reap_dead start 2024-02-26T12:19:24.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 --2- 172.21.15.113:0/3908659801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2000cf600 0x7fb20014e0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c7f0 tx=0x7fb1f000cbf0 comp rx=0 tx=0).stop 2024-02-26T12:19:24.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb205bca640 1 -- 172.21.15.113:0/3908659801 reap_dead start 2024-02-26T12:19:24.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7f1157fff640 1 -- 172.21.15.113:0/1829743335 <== osd.0 v2:172.21.15.113:6824/228866961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11700b46a0 con 0x7f115c073820 2024-02-26T12:19:24.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1d006b5a0 msgr2=0x7fb1d006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb1d006b5a0 0x7fb1d006da60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8037000 tx=0x7fb1d8031000 comp rx=0 tx=0).stop 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 shutdown_connections 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 >> 172.21.15.113:0/3908659801 conn(0x7fb20006ab50 msgr2=0x7fb2000cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 msgr2=0x7fb1e40485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1c14640 1 --2- 172.21.15.113:0/3762885026 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1e40501a0 0x7fb1e40485f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c390 tx=0x7fb1e000c850 comp rx=0 tx=0).stop 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.959+0000 7fb1f1413640 1 -- 172.21.15.113:0/3762885026 reap_dead start 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 shutdown_connections 2024-02-26T12:19:24.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 >> 172.21.15.113:0/3762885026 conn(0x7fb1e4009fb0 msgr2=0x7fb1e4033f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 shutdown_connections 2024-02-26T12:19:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 >> 172.21.15.113:0/1830955562 conn(0x7efe64072940 msgr2=0x7efe640cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 shutdown_connections 2024-02-26T12:19:24.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7fb20762d640 1 -- 172.21.15.113:0/3908659801 wait complete. 2024-02-26T12:19:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 shutdown_connections 2024-02-26T12:19:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.960+0000 7efe6b220640 1 -- 172.21.15.113:0/1830955562 wait complete. 2024-02-26T12:19:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 shutdown_connections 2024-02-26T12:19:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f115c073820 msgr2=0x7f115c075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f115c073820 0x7f115c075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7fb1f1c14640 1 -- 172.21.15.113:0/3762885026 wait complete. 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f115c06b5a0 msgr2=0x7f115c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f115c06b5a0 0x7f115c06da60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11640011f0 tx=0x7f1164001180 comp rx=0 tx=0).stop 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 msgr2=0x7f11701542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 --2- 172.21.15.113:0/1829743335 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f11700ced00 0x7f11701542b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1168009e50 tx=0x7f1168004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:25.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f116f7fe640 1 -- 172.21.15.113:0/1829743335 reap_dead start 2024-02-26T12:19:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 shutdown_connections 2024-02-26T12:19:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 >> 172.21.15.113:0/1829743335 conn(0x7f117006ab50 msgr2=0x7f1170163730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 shutdown_connections 2024-02-26T12:19:25.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:24.961+0000 7f1175876640 1 -- 172.21.15.113:0/1829743335 wait complete. 2024-02-26T12:19:25.002 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2024-02-26T12:19:25.003 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-26T12:19:25.003 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.004 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-26T12:19:25.005 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2024-02-26T12:19:25.005 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-26T12:19:25.005 INFO:teuthology.orchestra.run.smithi113.stdout:55834574856 2024-02-26T12:19:25.006 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-26T12:19:25.006 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.007 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-26T12:19:25.007 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2024-02-26T12:19:25.008 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-26T12:19:25.008 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.009 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-26T12:19:25.009 INFO:teuthology.orchestra.run.smithi113.stdout:55834574856 2024-02-26T12:19:25.010 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-26T12:19:25.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.224+0000 7f709722d640 1 Processor -- start 2024-02-26T12:19:25.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.224+0000 7f709722d640 1 -- start start 2024-02-26T12:19:25.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.225+0000 7f709722d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f70900ced00 0x7f7090163000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f709722d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7090163540 con 0x7f70901666b0 2024-02-26T12:19:25.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f709722d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900b36c0 con 0x7f7090166220 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f709722d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709006d5e0 con 0x7f70900ced00 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f70900ced00 0x7f7090163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f70900ced00 0x7f7090163000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48354/0 (socket says 172.21.15.113:48354) 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 -- 172.21.15.113:0/2483199012 learned_addr learned my addr 172.21.15.113:0/2483199012 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 -- 172.21.15.113:0/2483199012 >> v1:172.21.15.152:6789/0 conn(0x7f7090166220 legacy=0x7f709006da30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 -- 172.21.15.113:0/2483199012 >> v1:172.21.15.113:6789/0 conn(0x7f70901666b0 legacy=0x7f70900cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.226+0000 7f7094fc9640 1 -- 172.21.15.113:0/2483199012 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900b39a0 con 0x7f70900ced00 2024-02-26T12:19:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.228+0000 7f7094fc9640 1 --2- 172.21.15.113:0/2483199012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70900ced00 0x7f7090163000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca842c282d0989c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.228+0000 7f708f7fe640 1 -- 172.21.15.113:0/2483199012 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402e070 con 0x7f70900ced00 2024-02-26T12:19:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.228+0000 7f708f7fe640 1 -- 172.21.15.113:0/2483199012 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084037070 con 0x7f70900ced00 2024-02-26T12:19:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.228+0000 7fcaef1d4640 1 Processor -- start 2024-02-26T12:19:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7f708f7fe640 1 -- 172.21.15.113:0/2483199012 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7084031a00 con 0x7f70900ced00 2024-02-26T12:19:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7f709722d640 1 -- 172.21.15.113:0/2483199012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70900ced00 msgr2=0x7f7090163000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7f709722d640 1 --2- 172.21.15.113:0/2483199012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70900ced00 0x7f7090163000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402b880 comp rx=0 tx=0).stop 2024-02-26T12:19:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7fcaef1d4640 1 -- start start 2024-02-26T12:19:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7efd90c18640 1 Processor -- start 2024-02-26T12:19:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.229+0000 7efd90c18640 1 -- start start 2024-02-26T12:19:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7f709722d640 1 -- 172.21.15.113:0/2483199012 shutdown_connections 2024-02-26T12:19:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7f709722d640 1 --2- 172.21.15.113:0/2483199012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70900ced00 0x7f7090163000 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7f709722d640 1 -- 172.21.15.113:0/2483199012 >> 172.21.15.113:0/2483199012 conn(0x7f709006ab50 msgr2=0x7f709006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7f0ad191e640 1 Processor -- start 2024-02-26T12:19:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaef1d4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 0x7fcae80cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaef1d4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcae80cc430 0x7fcae80cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd90c18640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd8c1623d0 0x7efd8c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd90c18640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd8c0d2900 0x7efd8c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd90c18640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8c0d03c0 con 0x7efd8c0ce160 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd90c18640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0b6f40 con 0x7efd8c0d2900 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd90c18640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8c0cfe90 con 0x7efd8c1623d0 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd8a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd8c1623d0 0x7efd8c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd8a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efd8c1623d0 0x7efd8c0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48360/0 (socket says 172.21.15.113:48360) 2024-02-26T12:19:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7efd8a59c640 1 -- 172.21.15.113:0/3391289347 learned_addr learned my addr 172.21.15.113:0/3391289347 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaef1d4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80b73d0 con 0x7fcae80d14d0 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaef1d4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80cf460 con 0x7fcae80cc430 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaef1d4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80cefa0 con 0x7fcae815b7c0 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7fcaed9d1640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcae80d14d0 0x7fcae80cbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:59860/0 (socket says 172.21.15.113:59860) 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaed9d1640 1 -- 172.21.15.113:0/4234158033 learned_addr learned my addr 172.21.15.113:0/4234158033 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee9d3640 1 --2- 172.21.15.113:0/4234158033 >> v2:172.21.15.113:3300/0 conn(0x7fcae80cc430 0x7fcae80cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7efd8ad9d640 1 --2- 172.21.15.113:0/3391289347 >> v2:172.21.15.113:3300/0 conn(0x7efd8c0d2900 0x7efd8c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee1d2640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 0x7fcae80cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f224d47c640 1 Processor -- start 2024-02-26T12:19:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f224d47c640 1 -- start start 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.230+0000 7f0ad191e640 1 -- start start 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0ad191e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 0x7f0acc0ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627993120 0 0) 0x7fcae80b73d0 con 0x7fcae80d14d0 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad4003520 con 0x7fcae80d14d0 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee9d3640 1 -- 172.21.15.113:0/4234158033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 msgr2=0x7fcae80cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789280764 0 0) 0x7fcad4003520 con 0x7fcae80d14d0 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0ad191e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 0x7f0acc06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0ac3fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0acc0ce8a0 0x7f0acc0ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:59872/0 (socket says 172.21.15.113:59872) 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0acaffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 0x7f0acc0ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0acaffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 0x7f0acc0ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48364/0 (socket says 172.21.15.113:48364) 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee9d3640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 0x7fcae80cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee9d3640 1 -- 172.21.15.113:0/4234158033 >> v1:172.21.15.152:6789/0 conn(0x7fcae80d14d0 legacy=0x7fcae80cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7fcaee9d3640 1 -- 172.21.15.113:0/4234158033 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80ce440 con 0x7fcae80cc430 2024-02-26T12:19:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0ac3fff640 1 -- 172.21.15.113:0/3159530660 learned_addr learned my addr 172.21.15.113:0/3159530660 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7efd8a59c640 1 -- 172.21.15.113:0/3391289347 >> v2:172.21.15.113:3300/0 conn(0x7efd8c0d2900 msgr2=0x7efd8c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0cdb80 con 0x7f0acc0ce8a0 2024-02-26T12:19:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0acb7fe640 1 --2- 172.21.15.113:0/3159530660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 0x7f0acc06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7efd8a59c640 1 --2- 172.21.15.113:0/3391289347 >> v2:172.21.15.113:3300/0 conn(0x7efd8c0d2900 0x7efd8c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f709722d640 1 -- 172.21.15.113:0/2483199012 shutdown_connections 2024-02-26T12:19:25.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc0cb410 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0cc250 con 0x7f0acc0cf480 2024-02-26T12:19:25.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7efd8a59c640 1 -- 172.21.15.113:0/3391289347 >> v1:172.21.15.113:6789/0 conn(0x7efd8c0ce160 legacy=0x7efd8c0d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.231+0000 7efd8a59c640 1 -- 172.21.15.113:0/3391289347 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c1627b0 con 0x7efd8c1623d0 2024-02-26T12:19:25.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0aca7fc640 1 -- 172.21.15.113:0/3159530660 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239659905 0 0) 0x7f0acc0cdb80 con 0x7f0acc0ce8a0 2024-02-26T12:19:25.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7fcaee1d2640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 0x7fcae80cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:25.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0acb7fe640 1 -- 172.21.15.113:0/3159530660 >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 msgr2=0x7f0acc0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f224d47c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22480cf330 0x7f224809a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f71465d4640 1 Processor -- start 2024-02-26T12:19:25.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f71465d4640 1 -- start start 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f2247fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f224815bb00 0x7f22480ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57998/0 (socket says 172.21.15.113:57998) 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f2247fff640 1 -- 172.21.15.113:0/822030449 learned_addr learned my addr 172.21.15.113:0/822030449 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7efd8a59c640 1 --2- 172.21.15.113:0/3391289347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0b6960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd8c074010 tx=0x7efd7c02b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375b95edde32dce1 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480cc270 con 0x7f224815bb00 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224809ad20 con 0x7f22480cfbd0 2024-02-26T12:19:25.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480cf8f0 con 0x7f22480cf330 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7efd8959a640 1 -- 172.21.15.113:0/3391289347 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c035020 con 0x7efd8c1623d0 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7efd8959a640 1 -- 172.21.15.113:0/3391289347 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c031890 con 0x7efd8c1623d0 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7efd8959a640 1 -- 172.21.15.113:0/3391289347 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c031ca0 con 0x7efd8c1623d0 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7fcaee9d3640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80cc430 0x7fcae80cf8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10d407395d31266 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0039070 con 0x7fcae80cc430 2024-02-26T12:19:25.227 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae002c810 con 0x7fcae80cc430 2024-02-26T12:19:25.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7fcaed1d0640 1 -- 172.21.15.113:0/4234158033 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8001670 con 0x7fcae80cc430 2024-02-26T12:19:25.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0acb7fe640 1 --2- 172.21.15.113:0/3159530660 >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 0x7f0acc0ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0acb7fe640 1 -- 172.21.15.113:0/3159530660 >> v1:172.21.15.152:6789/0 conn(0x7f0acc0ce8a0 legacy=0x7f0acc0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f0acb7fe640 1 -- 172.21.15.113:0/3159530660 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0cc6e0 con 0x7f0acc0cf480 2024-02-26T12:19:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747202675 0 0) 0x7f224809ad20 con 0x7f22480cfbd0 2024-02-26T12:19:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2230003520 con 0x7f22480cfbd0 2024-02-26T12:19:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470222238 0 0) 0x7f22480cc270 con 0x7f224815bb00 2024-02-26T12:19:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f0acb7fe640 1 --2- 172.21.15.113:0/3159530660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 0x7f0acc06e480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400bfa0 tx=0x7f0ac402e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b19dabdf07f531 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.232+0000 7f709722d640 1 -- 172.21.15.113:0/2483199012 wait complete. 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224809ad20 con 0x7f224815bb00 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 -- 172.21.15.113:0/3391289347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 msgr2=0x7efd8c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 --2- 172.21.15.113:0/3391289347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0b6960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd8c074010 tx=0x7efd7c02b930 comp rx=0 tx=0).stop 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 -- 172.21.15.113:0/3391289347 shutdown_connections 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 --2- 172.21.15.113:0/3391289347 >> v2:172.21.15.113:3300/0 conn(0x7efd8c0d2900 0x7efd8c0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 --2- 172.21.15.113:0/3391289347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0b6960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7efd90c18640 1 -- 172.21.15.113:0/3391289347 >> 172.21.15.113:0/3391289347 conn(0x7efd8c0d0590 msgr2=0x7efd8c0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 -- 172.21.15.113:0/4234158033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80cc430 msgr2=0x7fcae80cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80cc430 0x7fcae80cf8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009d90 tx=0x7fcae002bce0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 -- 172.21.15.113:0/4234158033 shutdown_connections 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80cc430 0x7fcae80cf8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/4234158033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae815b7c0 0x7fcae80cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 -- 172.21.15.113:0/4234158033 >> 172.21.15.113:0/4234158033 conn(0x7fcae80b3260 msgr2=0x7fcae80b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7fcaef1d4640 1 -- 172.21.15.113:0/4234158033 shutdown_connections 2024-02-26T12:19:25.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f709722d640 1 Processor -- start 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71465d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7140159e30 0x7f71400b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71465d4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f714006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71465d4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71400b47f0 con 0x7f71400b4270 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71465d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400b4ad0 con 0x7f7140159e30 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71465d4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71400b26f0 con 0x7f71400718e0 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f7145dd3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f714006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f7145dd3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f714006d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:55990/0 (socket says 172.21.15.113:55990) 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f7145dd3640 1 -- 172.21.15.113:0/373048133 learned_addr learned my addr 172.21.15.113:0/373048133 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71455d2640 1 --2- 172.21.15.113:0/373048133 >> v2:172.21.15.152:3300/0 conn(0x7f7140159e30 0x7f71400b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71455d2640 1 -- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 msgr2=0x7f714006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71455d2640 1 --2- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f714006d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71455d2640 1 -- 172.21.15.113:0/373048133 >> v1:172.21.15.113:6789/0 conn(0x7f71400b4270 legacy=0x7f71400711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f71455d2640 1 -- 172.21.15.113:0/373048133 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400b29d0 con 0x7f7140159e30 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f0aca7fc640 1 -- 172.21.15.113:0/3159530660 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac402e9e0 con 0x7f0acc0cf480 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f0aca7fc640 1 -- 172.21.15.113:0/3159530660 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac402eb80 con 0x7f0acc0cf480 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f0aca7fc640 1 -- 172.21.15.113:0/3159530660 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4009540 con 0x7f0acc0cf480 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 msgr2=0x7f0acc06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f0ad191e640 1 --2- 172.21.15.113:0/3159530660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 0x7f0acc06e480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400bfa0 tx=0x7f0ac402e040 comp rx=0 tx=0).stop 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163210826 0 0) 0x7f2230003520 con 0x7f22480cfbd0 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 >> v2:172.21.15.152:3300/0 conn(0x7f22480cf330 msgr2=0x7f224809a450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-26T12:19:25.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 --2- 172.21.15.113:0/822030449 >> v2:172.21.15.152:3300/0 conn(0x7f22480cf330 0x7f224809a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 >> v1:172.21.15.113:6789/0 conn(0x7f224815bb00 legacy=0x7f22480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480cc510 con 0x7f22480cfbd0 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.233+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f22400019f0 con 0x7f22480cfbd0 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 >> v1:172.21.15.152:6789/0 conn(0x7f22480cfbd0 legacy=0x7f22480d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004c10 0x7f2230004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f22300037a0 0x7f2230003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 0x7f22300145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480cf8f0 con 0x7f2230004c10 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2230014b00 con 0x7f2230004160 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2230014c80 con 0x7f22300037a0 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 0x7f22300145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f22477fe640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f22300037a0 0x7f2230003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 -- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f22300037a0 msgr2=0x7f2230003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f22300037a0 0x7f2230003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 -- 172.21.15.113:0/822030449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004c10 msgr2=0x7f2230004ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004c10 0x7f2230004ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f224cc7b640 1 -- 172.21.15.113:0/822030449 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22480cc510 con 0x7f2230004160 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7efd90c18640 1 -- 172.21.15.113:0/3391289347 shutdown_connections 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 shutdown_connections 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 --2- 172.21.15.113:0/3159530660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cf480 0x7f0acc06e480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 --2- 172.21.15.113:0/3159530660 >> v2:172.21.15.152:3300/0 conn(0x7f0acc0cd7a0 0x7f0acc0ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 >> 172.21.15.113:0/3159530660 conn(0x7f0acc099a40 msgr2=0x7f0acc0d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.234+0000 7f709722d640 1 -- start start 2024-02-26T12:19:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7fed61826640 1 Processor -- start 2024-02-26T12:19:25.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7efd90c18640 1 -- 172.21.15.113:0/3391289347 wait complete. 2024-02-26T12:19:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7fcaef1d4640 1 -- 172.21.15.113:0/4234158033 wait complete. 2024-02-26T12:19:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f71455d2640 1 --2- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140159e30 0x7f71400b31d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71300097a0 tx=0x7f713002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b9dbecc344e5fb server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 shutdown_connections 2024-02-26T12:19:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f224cc7b640 1 -- 172.21.15.113:0/822030449 reap_dead start 2024-02-26T12:19:25.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f224cc7b640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 0x7f22300145c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f224000c510 tx=0x7f2230005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664a2eea0774fecf server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f709722d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f70900ced00 0x7f70900ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f709722d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7090166220 0x7f709015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f709722d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f709722d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090165d00 con 0x7f7090166220 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f709722d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70900b3f60 con 0x7f70901666b0 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f709722d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709006e140 con 0x7f70900ced00 2024-02-26T12:19:25.238 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f602971e640 1 Processor -- start 2024-02-26T12:19:25.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240039070 con 0x7f2230004160 2024-02-26T12:19:25.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224002cd80 con 0x7f2230004160 2024-02-26T12:19:25.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f7137fff640 1 -- 172.21.15.113:0/373048133 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130035020 con 0x7f7140159e30 2024-02-26T12:19:25.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f2246ffd640 1 -- 172.21.15.113:0/822030449 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000c0e0 con 0x7f2230004160 2024-02-26T12:19:25.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f7137fff640 1 -- 172.21.15.113:0/373048133 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130031830 con 0x7f7140159e30 2024-02-26T12:19:25.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48404/0 (socket says 172.21.15.113:48404) 2024-02-26T12:19:25.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 -- 172.21.15.113:0/2153961004 learned_addr learned my addr 172.21.15.113:0/2153961004 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f708ffff640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7090166220 0x7f709015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f7137fff640 1 -- 172.21.15.113:0/373048133 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130031c40 con 0x7f7140159e30 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 -- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f70900ced00 msgr2=0x7f70900ad190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f70900ced00 0x7f70900ad190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 -- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7090166220 msgr2=0x7f709015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7090166220 0x7f709015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 -- 172.21.15.113:0/2153961004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709015fa60 con 0x7f70901666b0 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7fed61826640 1 -- start start 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61826640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fed54006b40 0x7fed54007f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61826640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54055d00 con 0x7fed540342e0 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61826640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54055fe0 con 0x7fed540dfa50 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61826640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed54036a70 con 0x7fed54006b40 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fcaef1d4640 1 Processor -- start 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61025640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fed540342e0 0x7fed54053980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58012/0 (socket says 172.21.15.113:58012) 2024-02-26T12:19:25.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7fed61025640 1 -- 172.21.15.113:0/4289278097 learned_addr learned my addr 172.21.15.113:0/4289278097 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7efd90c18640 1 Processor -- start 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7efd90c18640 1 -- start start 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efd8c0d2900 0x7efd8c160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.236+0000 7f70957ca640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f708800c780 tx=0x7f708800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f70901666b0 2024-02-26T12:19:25.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088003d80 con 0x7f70901666b0 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880052b0 con 0x7f70901666b0 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709015fd40 con 0x7f70901666b0 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f71465d4640 1 -- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140159e30 msgr2=0x7f71400b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f71465d4640 1 --2- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140159e30 0x7f71400b31d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71300097a0 tx=0x7f713002b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.235+0000 7f0ad191e640 1 -- 172.21.15.113:0/3159530660 wait complete. 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f0ad191e640 1 Processor -- start 2024-02-26T12:19:25.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f0ad191e640 1 -- start start 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429861260 0 0) 0x7fed54055d00 con 0x7fed540342e0 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed4c003520 con 0x7fed540342e0 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252433817 0 0) 0x7fed4c003520 con 0x7fed540342e0 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 >> v2:172.21.15.113:3300/0 conn(0x7fed54006b40 msgr2=0x7fed54007f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 --2- 172.21.15.113:0/4289278097 >> v2:172.21.15.113:3300/0 conn(0x7fed54006b40 0x7fed54007f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 >> v1:172.21.15.152:6789/0 conn(0x7fed540dfa50 legacy=0x7fed54006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54034d10 con 0x7fed540342e0 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fed50001670 con 0x7fed540342e0 2024-02-26T12:19:25.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 >> v1:172.21.15.113:6789/0 conn(0x7fed540342e0 legacy=0x7fed54053980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 msgr2=0x7f22300145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 0x7f22300145c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f224000c510 tx=0x7f2230005830 comp rx=0 tx=0).stop 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 shutdown_connections 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 --2- 172.21.15.113:0/822030449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2230004160 0x7f22300145c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 >> 172.21.15.113:0/822030449 conn(0x7f22480b3250 msgr2=0x7f22480b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 shutdown_connections 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f224d47c640 1 -- 172.21.15.113:0/822030449 wait complete. 2024-02-26T12:19:25.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.237+0000 7f602971e640 1 -- start start 2024-02-26T12:19:25.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0b9570 con 0x7efd8c0ce160 2024-02-26T12:19:25.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0d00e0 con 0x7efd8c1623d0 2024-02-26T12:19:25.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70900a8540 con 0x7f70901666b0 2024-02-26T12:19:25.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd90c18640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c0b9850 con 0x7efd8c0d2900 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fcaef1d4640 1 -- start start 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c0039b0 0x7fed4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 0x7fed4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed4c0052e0 0x7fed4c005990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38412/0 (socket says 172.21.15.113:38412) 2024-02-26T12:19:25.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 -- 172.21.15.113:0/3595097125 learned_addr learned my addr 172.21.15.113:0/3595097125 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54036a70 con 0x7fed4c004800 2024-02-26T12:19:25.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c006270 con 0x7fed4c0052e0 2024-02-26T12:19:25.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c006470 con 0x7fed4c0039b0 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f602971e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f60240aec50 0x7f602406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f602971e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602406eb10 con 0x7f60240cfcf0 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f602971e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6024166a40 con 0x7f6024165ba0 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f602971e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6024162940 con 0x7f60240aec50 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 0x7f0acc0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed61025640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed4c0052e0 0x7fed4c005990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f60227fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6024165ba0 0x7f60240cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:59900/0 (socket says 172.21.15.113:59900) 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f60227fc640 1 -- 172.21.15.113:0/1805313749 learned_addr learned my addr 172.21.15.113:0/1805313749 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f6022ffd640 1 --2- 172.21.15.113:0/1805313749 >> v2:172.21.15.152:3300/0 conn(0x7f60240aec50 0x7f602406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f71465d4640 1 -- 172.21.15.113:0/373048133 shutdown_connections 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f71465d4640 1 --2- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f714006d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f71465d4640 1 --2- 172.21.15.113:0/373048133 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7140159e30 0x7f71400b31d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f71465d4640 1 -- 172.21.15.113:0/373048133 >> 172.21.15.113:0/373048133 conn(0x7f714006af70 msgr2=0x7f714006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0acaffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0acaffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:56004/0 (socket says 172.21.15.113:56004) 2024-02-26T12:19:25.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7fed60824640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c0039b0 0x7fed4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0acc0cf480 0x7f0acc147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0cbc00 con 0x7f0acc0ce8a0 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0cb920 con 0x7f0acc0cf480 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0ad191e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0cbee0 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7f0acaffd640 1 -- 172.21.15.113:0/2292589158 learned_addr learned my addr 172.21.15.113:0/2292589158 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 -- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efd8c0d2900 msgr2=0x7efd8c160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efd8c0d2900 0x7efd8c160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 -- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 msgr2=0x7efd8c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.238+0000 7efd8a59c640 1 -- 172.21.15.113:0/3595097125 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c0cb030 con 0x7efd8c0ce160 2024-02-26T12:19:25.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 0x7fed4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f0ac3fff640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 0x7f0acc0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7efd8a59c640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0097c0 tx=0x7efd7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f71465d4640 1 -- 172.21.15.113:0/373048133 shutdown_connections 2024-02-26T12:19:25.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f0acaffd640 1 -- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0acc0cf480 msgr2=0x7f0acc147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f0acaffd640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0acc0cf480 0x7f0acc147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f0acaffd640 1 -- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 msgr2=0x7f0acc0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f224d47c640 1 Processor -- start 2024-02-26T12:19:25.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 0x7fcae8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 0x7fcae80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae815b7c0 0x7fcae80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80cecc0 con 0x7fcae80d14d0 2024-02-26T12:19:25.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80ce9e0 con 0x7fcae815b7c0 2024-02-26T12:19:25.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 -- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c0039b0 msgr2=0x7fed4c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c0039b0 0x7fed4c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 -- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed4c0052e0 msgr2=0x7fed4c005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed4c0052e0 0x7fed4c005990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fed5bfff640 1 -- 172.21.15.113:0/4289278097 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c003520 con 0x7fed4c004800 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897167344 0 0) 0x7f6024166a40 con 0x7f6024165ba0 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6010003520 con 0x7f6024165ba0 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501744241 0 0) 0x7f602406eb10 con 0x7f60240cfcf0 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6024166a40 con 0x7f60240cfcf0 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6022ffd640 1 -- 172.21.15.113:0/1805313749 >> v1:172.21.15.152:6789/0 conn(0x7f6024165ba0 legacy=0x7f60240cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6022ffd640 1 -- 172.21.15.113:0/1805313749 >> v1:172.21.15.113:6789/0 conn(0x7f60240cfcf0 legacy=0x7f60240b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f6022ffd640 1 -- 172.21.15.113:0/1805313749 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024166760 con 0x7f60240aec50 2024-02-26T12:19:25.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaef1d4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815bba0 con 0x7fcae80cc430 2024-02-26T12:19:25.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090074a50 con 0x7f70901666b0 2024-02-26T12:19:25.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f224d47c640 1 -- start start 2024-02-26T12:19:25.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaee1d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 0x7fcae8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaee1d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 0x7fcae8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:56026/0 (socket says 172.21.15.113:56026) 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaee1d2640 1 -- 172.21.15.113:0/1417270444 learned_addr learned my addr 172.21.15.113:0/1417270444 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7fcaed9d1640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 0x7fcae80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 -- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 msgr2=0x7fcae8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 0x7fcae8152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 -- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae815b7c0 msgr2=0x7fcae80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae815b7c0 0x7fcae80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 -- 172.21.15.113:0/1417270444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80cb680 con 0x7fcae80d14d0 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcaed9d1640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 0x7fcae80cb080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001380 tx=0x7fcad800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7088005450 con 0x7f70901666b0 2024-02-26T12:19:25.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7f71465d4640 1 -- 172.21.15.113:0/373048133 wait complete. 2024-02-26T12:19:25.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7f0acaffd640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 0x7f0acc0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7f0acaffd640 1 -- 172.21.15.113:0/2292589158 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0b4090 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7f0ac3fff640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 0x7f0acc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:25.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fed61025640 1 -- 172.21.15.113:0/4289278097 reap_dead start 2024-02-26T12:19:25.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8017070 con 0x7fcae80d14d0 2024-02-26T12:19:25.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8005d00 con 0x7fcae80d14d0 2024-02-26T12:19:25.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 0x7f22480c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80072b0 con 0x7fcae80d14d0 2024-02-26T12:19:25.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae80cb960 con 0x7fcae80d14d0 2024-02-26T12:19:25.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7fed5bfff640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 0x7fed4c004c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0649c0 tx=0x7fed4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4487d4c1d123d153 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f708d7fa640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 0x7f707406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f0acaffd640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00e870 tx=0x7f0abc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 0x7f22480b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f71465d4640 1 Processor -- start 2024-02-26T12:19:25.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 0x7f22480b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f6022ffd640 1 --2- 172.21.15.113:0/1805313749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240aec50 0x7f602406e5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f601c0097a0 tx=0x7f601c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86516cb87e6070 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224809a450 con 0x7f2230004160 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f71465d4640 1 -- start start 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f2247fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 0x7f22480c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f2247fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 0x7f22480c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38450/0 (socket says 172.21.15.113:38450) 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f2247fff640 1 -- 172.21.15.113:0/1402402182 learned_addr learned my addr 172.21.15.113:0/1402402182 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f7094fc9640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 0x7f707406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224cc7b640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 0x7f22480b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f22477fe640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 0x7f22480b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480ccad0 con 0x7f22480b6360 2024-02-26T12:19:25.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224809a5d0 con 0x7f2248155b30 2024-02-26T12:19:25.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.241+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7088089740 con 0x7f70901666b0 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc017070 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.239+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c040070 con 0x7efd8c0ce160 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c030d20 con 0x7efd8c0ce160 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c035040 con 0x7efd8c0ce160 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c0cb310 con 0x7efd8c0ce160 2024-02-26T12:19:25.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.240+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c0cb8d0 con 0x7efd8c0ce160 2024-02-26T12:19:25.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00c940 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0b2070 con 0x7fed4c004800 2024-02-26T12:19:25.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd70005290 con 0x7efd8c0ce160 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 -- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 msgr2=0x7f22480b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 0x7f22480b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 -- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 msgr2=0x7f22480c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 0x7f22480c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224815e4a0 con 0x7f22480b6360 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f22477fe640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 0x7f22480b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:25.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f7094fc9640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 0x7f707406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae8156640 con 0x7fcae80d14d0 2024-02-26T12:19:25.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71400b4270 0x7f714006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140159e30 0x7f7140145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714006f3e0 con 0x7f7140159e30 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714015a210 con 0x7f71400b4270 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71465d4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7140149e30 con 0x7f71400718e0 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71455d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71455d2640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:56050/0 (socket says 172.21.15.113:56050) 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f71455d2640 1 -- 172.21.15.113:0/1995597953 learned_addr learned my addr 172.21.15.113:0/1995597953 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f7144dd1640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71400b4270 0x7f714006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00cd30 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f0ad191e640 1 -- 172.21.15.113:0/2292589158 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc0b4330 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f0ad191e640 1 -- 172.21.15.113:0/2292589158 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc0b48f0 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0ad620 con 0x7fed4c004800 2024-02-26T12:19:25.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7fed5b7fe640 1 -- 172.21.15.113:0/4289278097 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c04f530 con 0x7fed4c004800 2024-02-26T12:19:25.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.242+0000 7f224cc7b640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 0x7f22480b67f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22480d0da0 tx=0x7f2240001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 -- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71400b4270 msgr2=0x7f714006eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71400b4270 0x7f714006eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 -- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140159e30 msgr2=0x7f7140145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140159e30 0x7f7140145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 -- 172.21.15.113:0/1995597953 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714014c2f0 con 0x7f71400718e0 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f71455d2640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7130034040 tx=0x7f71300046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8156840 con 0x7fcae80d14d0 2024-02-26T12:19:25.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd7c04b060 con 0x7efd8c0ce160 2024-02-26T12:19:25.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 -- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 msgr2=0x7fed4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.243+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130040070 con 0x7f71400718e0 2024-02-26T12:19:25.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130039980 con 0x7f71400718e0 2024-02-26T12:19:25.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130035040 con 0x7f71400718e0 2024-02-26T12:19:25.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714014c5d0 con 0x7f71400718e0 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 0x7fed4c004c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0649c0 tx=0x7fed4c005830 comp rx=0 tx=0).stop 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 -- 172.21.15.113:0/4289278097 shutdown_connections 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 --2- 172.21.15.113:0/4289278097 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed4c004800 0x7fed4c004c80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 -- 172.21.15.113:0/4289278097 >> 172.21.15.113:0/4289278097 conn(0x7fed5401e6b0 msgr2=0x7fed540553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f0ad191e640 1 -- 172.21.15.113:0/2292589158 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc068180 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 -- 172.21.15.113:0/4289278097 shutdown_connections 2024-02-26T12:19:25.275 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7fed61826640 1 -- 172.21.15.113:0/4289278097 wait complete. 2024-02-26T12:19:25.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714014cb90 con 0x7f71400718e0 2024-02-26T12:19:25.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7efd7affd640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 0x7efd6c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0abc01a070 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.244+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd7c0ac2b0 con 0x7efd8c0ce160 2024-02-26T12:19:25.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7efd89d9b640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 0x7efd6c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7f0ac8ff9640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 0x7f0aac06da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0abc08a300 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7f0ac3fff640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 0x7f0aac06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7efd89d9b640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 0x7efd6c06d9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd8c15d120 tx=0x7efd800079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714004f030 con 0x7f71400718e0 2024-02-26T12:19:25.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7fed61826640 1 Processor -- start 2024-02-26T12:19:25.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7f0ac3fff640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 0x7f0aac06da90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0b3fc0 tx=0x7f0ab4007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.245+0000 7fed61826640 1 -- start start 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c034070 con 0x7f60240aec50 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c030610 con 0x7f60240aec50 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f6021ffb640 1 -- 172.21.15.113:0/1805313749 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0309e0 con 0x7f60240aec50 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240039040 con 0x7f22480b6360 2024-02-26T12:19:25.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240043070 con 0x7f22480b6360 2024-02-26T12:19:25.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240003970 con 0x7f22480b6360 2024-02-26T12:19:25.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7088057ed0 con 0x7f70901666b0 2024-02-26T12:19:25.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22480b55a0 con 0x7f22480b6360 2024-02-26T12:19:25.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7130038020 con 0x7f71400718e0 2024-02-26T12:19:25.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22480b5b60 con 0x7f22480b6360 2024-02-26T12:19:25.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.246+0000 7f7135ffb640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 0x7f712406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71300abab0 con 0x7f71400718e0 2024-02-26T12:19:25.281 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c004800 0x7fed540d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f7144dd1640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 0x7f712406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f602971e640 1 -- 172.21.15.113:0/1805313749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240aec50 msgr2=0x7f602406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f602971e640 1 --2- 172.21.15.113:0/1805313749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240aec50 0x7f602406e5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f601c0097a0 tx=0x7f601c02b960 comp rx=0 tx=0).stop 2024-02-26T12:19:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f602971e640 1 -- 172.21.15.113:0/1805313749 shutdown_connections 2024-02-26T12:19:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f602971e640 1 --2- 172.21.15.113:0/1805313749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240aec50 0x7f602406e5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f602971e640 1 -- 172.21.15.113:0/1805313749 >> 172.21.15.113:0/1805313749 conn(0x7f602406ab50 msgr2=0x7f602406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed540de3e0 0x7fed540de860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54036810 con 0x7fed540de3e0 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54036690 con 0x7fed5404af20 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61826640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed54007f60 con 0x7fed4c004800 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:48478/0 (socket says 172.21.15.113:48478) 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed5bfff640 1 -- 172.21.15.113:0/2943720747 learned_addr learned my addr 172.21.15.113:0/2943720747 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed60824640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c004800 0x7fed540d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7fed61025640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed540de3e0 0x7fed540de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.247+0000 7f7144dd1640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 0x7f712406da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f714014ff10 tx=0x7f713c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 -- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c004800 msgr2=0x7fed540d7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c004800 0x7fed540d7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 -- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed540de3e0 msgr2=0x7fed540de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed540de3e0 0x7fed540de860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 -- 172.21.15.113:0/2943720747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540deda0 con 0x7fed5404af20 2024-02-26T12:19:25.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224806f0d0 con 0x7f22480b6360 2024-02-26T12:19:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7f602971e640 1 -- 172.21.15.113:0/1805313749 shutdown_connections 2024-02-26T12:19:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7f602971e640 1 -- 172.21.15.113:0/1805313749 wait complete. 2024-02-26T12:19:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed5bfff640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed5c069820 tx=0x7fed5c068a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f224003c070 con 0x7f22480b6360 2024-02-26T12:19:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0bd030 con 0x7fed5404af20 2024-02-26T12:19:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0b8470 con 0x7fed5404af20 2024-02-26T12:19:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540d86f0 con 0x7fed5404af20 2024-02-26T12:19:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540d8cb0 con 0x7fed5404af20 2024-02-26T12:19:25.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0b2040 con 0x7fed5404af20 2024-02-26T12:19:25.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.248+0000 7f2244ff9640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 0x7f223406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.249+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22400ab750 con 0x7f22480b6360 2024-02-26T12:19:25.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.249+0000 7f2247fff640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 0x7f223406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.249+0000 7f2247fff640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 0x7f223406d9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2238001eb0 tx=0x7f2238001720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.249+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c005290 con 0x7fed5404af20 2024-02-26T12:19:25.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.249+0000 7f602971e640 1 Processor -- start 2024-02-26T12:19:25.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.250+0000 7f602971e640 1 -- start start 2024-02-26T12:19:25.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.250+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0abc058ba0 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.289 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.250+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd7c02d040 con 0x7efd8c0ce160 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.250+0000 7f602971e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 0x7f602415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f602971e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 0x7f6024149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 0x7f602415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 0x7f602415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:56070/0 (socket says 172.21.15.113:56070) 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f60227fc640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 0x7f6024149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f6022ffd640 1 -- 172.21.15.113:0/3098038108 learned_addr learned my addr 172.21.15.113:0/3098038108 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 0x7f60240b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602406e0b0 con 0x7f6024165ba0 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f60237fe640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 0x7f60240b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602406ddd0 con 0x7f60240cfcf0 2024-02-26T12:19:25.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.251+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240af030 con 0x7f60240aec50 2024-02-26T12:19:25.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcad801a070 con 0x7fcae80d14d0 2024-02-26T12:19:25.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7fcadeffd640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 0x7fcacc06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 -- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 msgr2=0x7f602415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 0x7f602415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 -- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 msgr2=0x7f60240b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 0x7f60240b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60241fc0b0 con 0x7f60240cfcf0 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60237fe640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 0x7f60240b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7f60227fc640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 0x7f6024149840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f600c005880 tx=0x7f600c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.252+0000 7fcaee1d2640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 0x7fcacc06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcad8089b20 con 0x7fcae80d14d0 2024-02-26T12:19:25.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7fcaee1d2640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 0x7fcacc06da60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcae4006d40 tx=0x7fcae4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f224806f0d0 con 0x7f22480b6360 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c017070 con 0x7f60240cfcf0 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c005ce0 con 0x7f60240cfcf0 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c007310 con 0x7f60240cfcf0 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602415c8c0 con 0x7f60240cfcf0 2024-02-26T12:19:25.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.253+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602415ce80 con 0x7f60240cfcf0 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.255+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f713007a910 con 0x7f71400718e0 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.255+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed5c0c0070 con 0x7fed5404af20 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.255+0000 7fed597fa640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 0x7fed4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.255+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed5c127120 con 0x7fed5404af20 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.255+0000 7fed60824640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 0x7fed4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.256+0000 7fed60824640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 0x7fed4006d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed54003e70 tx=0x7fed48004840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.258+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602415d080 con 0x7f60240cfcf0 2024-02-26T12:19:25.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.258+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed540deda0 con 0x7fed5404af20 2024-02-26T12:19:25.296 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.260+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f600c01a070 con 0x7f60240cfcf0 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.260+0000 7f601b7fe640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 0x7f600406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.260+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f600c089940 con 0x7f60240cfcf0 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.260+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcae8156840 con 0x7fcae80d14d0 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.261+0000 7f6022ffd640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 0x7f600406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.261+0000 7f6022ffd640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 0x7f600406d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f601c009560 tx=0x7f601c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.266+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f602415d080 con 0x7f60240cfcf0 2024-02-26T12:19:25.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.653+0000 7f0ad191e640 1 -- 172.21.15.113:0/2292589158 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0acc074a50 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.654+0000 7f0ac8ff9640 1 -- 172.21.15.113:0/2292589158 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0abc05cc40 con 0x7f0acc0cd7a0 2024-02-26T12:19:25.639 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd70005850 con 0x7efd8c0ce160 2024-02-26T12:19:25.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 msgr2=0x7f0aac06da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 0x7f0aac06da90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0b3fc0 tx=0x7f0ab4007d50 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 msgr2=0x7f0acc0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00e870 tx=0x7f0abc00ed30 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 shutdown_connections 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0aac06b5d0 0x7f0aac06da90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0acc0cf480 0x7f0acc147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0acc0ce8a0 0x7f0acc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 --2- 172.21.15.113:0/2292589158 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0acc0cd7a0 0x7f0acc0c9340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 >> 172.21.15.113:0/2292589158 conn(0x7f0acc099a40 msgr2=0x7f0acc0d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7efd7affd640 1 -- 172.21.15.113:0/3595097125 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd7c04b350 con 0x7efd8c0ce160 2024-02-26T12:19:25.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.657+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 shutdown_connections 2024-02-26T12:19:25.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.658+0000 7f0ac1ffb640 1 -- 172.21.15.113:0/2292589158 wait complete. 2024-02-26T12:19:25.644 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2024-02-26T12:19:25.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.660+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 msgr2=0x7efd6c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.660+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7090072330 con 0x7f70901666b0 2024-02-26T12:19:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 0x7efd6c06d9e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd8c15d120 tx=0x7efd800079b0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 msgr2=0x7efd8c1651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0097c0 tx=0x7efd7c0046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7f708d7fa640 1 -- 172.21.15.113:0/2153961004 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f708805bf70 con 0x7f70901666b0 2024-02-26T12:19:25.647 INFO:teuthology.orchestra.run.smithi113.stdout:55834574853 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 shutdown_connections 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efd6c06b520 0x7efd6c06d9e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd8c1623d0 0x7efd8c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.661+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efd8c0d2900 0x7efd8c160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.662+0000 7efd90c18640 1 --2- 172.21.15.113:0/3595097125 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd8c0ce160 0x7efd8c1651a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.662+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 >> 172.21.15.113:0/3595097125 conn(0x7efd8c0d0590 msgr2=0x7efd8c0b8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.662+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 shutdown_connections 2024-02-26T12:19:25.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.662+0000 7efd90c18640 1 -- 172.21.15.113:0/3595097125 wait complete. 2024-02-26T12:19:25.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71400b3b40 con 0x7f71400718e0 2024-02-26T12:19:25.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 msgr2=0x7f707406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 0x7f707406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 msgr2=0x7f70900a8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f708800c780 tx=0x7f708800cc40 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 shutdown_connections 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f707406b4d0 0x7f707406d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70901666b0 0x7f70900a8d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7090166220 0x7f709015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f709722d640 1 --2- 172.21.15.113:0/2153961004 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f70900ced00 0x7f70900ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.665+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 >> 172.21.15.113:0/2153961004 conn(0x7f709006ab50 msgr2=0x7f70900b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.664+0000 7f7135ffb640 1 -- 172.21.15.113:0/1995597953 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f713007a910 con 0x7f71400718e0 2024-02-26T12:19:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.665+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 shutdown_connections 2024-02-26T12:19:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.665+0000 7f709722d640 1 -- 172.21.15.113:0/2153961004 wait complete. 2024-02-26T12:19:25.651 INFO:teuthology.orchestra.run.smithi113.stdout:55834574856 2024-02-26T12:19:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.668+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 msgr2=0x7f712406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.668+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 0x7f712406da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f714014ff10 tx=0x7f713c009040 comp rx=0 tx=0).stop 2024-02-26T12:19:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.668+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 msgr2=0x7f7140156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.668+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7130034040 tx=0x7f71300046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.654 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.669+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f224804f030 con 0x7f22480b6360 2024-02-26T12:19:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.669+0000 7f2244ff9640 1 -- 172.21.15.113:0/1402402182 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2240079ed0 con 0x7f22480b6360 2024-02-26T12:19:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcae80d2440 con 0x7fcae80d14d0 2024-02-26T12:19:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 shutdown_connections 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f712406b5a0 0x7f712406da60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7140159e30 0x7f7140145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71400b4270 0x7f714006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 --2- 172.21.15.113:0/1995597953 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71400718e0 0x7f7140156c40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 >> 172.21.15.113:0/1995597953 conn(0x7f714006af70 msgr2=0x7f71400aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 shutdown_connections 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7f71465d4640 1 -- 172.21.15.113:0/1995597953 wait complete. 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.671+0000 7fcadeffd640 1 -- 172.21.15.113:0/1417270444 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcad8021020 con 0x7fcae80d14d0 2024-02-26T12:19:25.657 INFO:teuthology.orchestra.run.smithi113.stdout:55834574855 2024-02-26T12:19:25.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.672+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fed3c005850 con 0x7fed5404af20 2024-02-26T12:19:25.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 msgr2=0x7f223406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 0x7f223406d9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2238001eb0 tx=0x7f2238001720 comp rx=0 tx=0).stop 2024-02-26T12:19:25.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7fed597fa640 1 -- 172.21.15.113:0/2943720747 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed5c0f5930 con 0x7fed5404af20 2024-02-26T12:19:25.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 msgr2=0x7f22480b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 0x7f22480b67f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22480d0da0 tx=0x7f2240001cf0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.675+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 msgr2=0x7fcacc06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.675+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 0x7fcacc06da60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcae4006d40 tx=0x7fcae4008040 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.675+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 msgr2=0x7fcae80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.675+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 0x7fcae80cb080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001380 tx=0x7fcad800c9c0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 shutdown_connections 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcacc06b5a0 0x7fcacc06da60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae815b7c0 0x7fcae80c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae80d14d0 0x7fcae80cb080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 --2- 172.21.15.113:0/1417270444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae80cc430 0x7fcae8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 >> 172.21.15.113:0/1417270444 conn(0x7fcae80b3260 msgr2=0x7fcae806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 shutdown_connections 2024-02-26T12:19:25.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fcaef1d4640 1 -- 172.21.15.113:0/1417270444 wait complete. 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stdout:55834574854 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 shutdown_connections 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f223406b520 0x7f223406d9e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22480b6360 0x7f22480b67f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2248155b30 0x7f22480b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 --2- 172.21.15.113:0/1402402182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2230004160 0x7f22480c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 >> 172.21.15.113:0/1402402182 conn(0x7f22480b3250 msgr2=0x7f2248070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 shutdown_connections 2024-02-26T12:19:25.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.673+0000 7f224d47c640 1 -- 172.21.15.113:0/1402402182 wait complete. 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 msgr2=0x7fed4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.676+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 0x7fed4006d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed54003e70 tx=0x7fed48004840 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 msgr2=0x7fed5404b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed5c069820 tx=0x7fed5c068a20 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 shutdown_connections 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fed4006b4d0 0x7fed4006d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed540de3e0 0x7fed540de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed5404af20 0x7fed5404b3a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 --2- 172.21.15.113:0/2943720747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed4c004800 0x7fed540d7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 >> 172.21.15.113:0/2943720747 conn(0x7fed5401e6b0 msgr2=0x7fed54037790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 shutdown_connections 2024-02-26T12:19:25.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.677+0000 7fed61826640 1 -- 172.21.15.113:0/2943720747 wait complete. 2024-02-26T12:19:25.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-02-26T12:19:25.667 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.680+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6024074a50 con 0x7f60240cfcf0 2024-02-26T12:19:25.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.681+0000 7f601b7fe640 1 -- 172.21.15.113:0/3098038108 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f600c021020 con 0x7f60240cfcf0 2024-02-26T12:19:25.667 INFO:teuthology.orchestra.run.smithi113.stdout:55834574856 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 msgr2=0x7f600406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 0x7f600406d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f601c009560 tx=0x7f601c03b040 comp rx=0 tx=0).stop 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 msgr2=0x7f6024149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 0x7f6024149840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f600c005880 tx=0x7f600c00c820 comp rx=0 tx=0).stop 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 shutdown_connections 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f600406b4d0 0x7f600406d990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6024165ba0 0x7f60240b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60240cfcf0 0x7f6024149840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 --2- 172.21.15.113:0/3098038108 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60240aec50 0x7f602415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 >> 172.21.15.113:0/3098038108 conn(0x7f602406ab50 msgr2=0x7f60240af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 shutdown_connections 2024-02-26T12:19:25.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.684+0000 7f602971e640 1 -- 172.21.15.113:0/3098038108 wait complete. 2024-02-26T12:19:25.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-02-26T12:19:25.671 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-02-26T12:19:25.672 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-02-26T12:19:25.679 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-02-26T12:19:25.680 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-02-26T12:19:25.682 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-02-26T12:19:25.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-02-26T12:19:25.684 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.684 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:25.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-26T12:19:25.685 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:19:25.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.839+0000 7f0413784640 1 Processor -- start 2024-02-26T12:19:25.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.839+0000 7f0413784640 1 -- start start 2024-02-26T12:19:25.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0413784640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 0x7f040c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0413784640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 0x7f040c0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0413784640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c0711d0 con 0x7f040c15db00 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0413784640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040c0714b0 con 0x7f040c070c60 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0413784640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c071790 con 0x7f040c15dee0 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0410d1f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 0x7f040c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0411d21640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 0x7f040c0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0411520640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f040c15db00 0x7f040c0cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:59914/0 (socket says 172.21.15.113:59914) 2024-02-26T12:19:25.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.840+0000 7f0411520640 1 -- 172.21.15.113:0/1608569192 learned_addr learned my addr 172.21.15.113:0/1608569192 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.841+0000 7f0410d1f640 1 -- 172.21.15.113:0/1608569192 >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 msgr2=0x7f040c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.841+0000 7f0410d1f640 1 --2- 172.21.15.113:0/1608569192 >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 0x7f040c0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.841+0000 7f0410d1f640 1 -- 172.21.15.113:0/1608569192 >> v1:172.21.15.152:6789/0 conn(0x7f040c15db00 legacy=0x7f040c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.841+0000 7f0410d1f640 1 -- 172.21.15.113:0/1608569192 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c071a70 con 0x7f040c15dee0 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.841+0000 7f0411d21640 1 --2- 172.21.15.113:0/1608569192 >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 0x7f040c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0410d1f640 1 --2- 172.21.15.113:0/1608569192 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 0x7f040c0b3350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097d0 tx=0x7f03fc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2dad1cb0caa05c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0403fff640 1 -- 172.21.15.113:0/1608569192 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc035020 con 0x7f040c15dee0 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0403fff640 1 -- 172.21.15.113:0/1608569192 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc031800 con 0x7f040c15dee0 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0403fff640 1 -- 172.21.15.113:0/1608569192 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc031bd0 con 0x7f040c15dee0 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 -- 172.21.15.113:0/1608569192 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 msgr2=0x7f040c0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 --2- 172.21.15.113:0/1608569192 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 0x7f040c0b3350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097d0 tx=0x7f03fc02b8a0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 -- 172.21.15.113:0/1608569192 shutdown_connections 2024-02-26T12:19:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 --2- 172.21.15.113:0/1608569192 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15dee0 0x7f040c0b3350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 --2- 172.21.15.113:0/1608569192 >> v2:172.21.15.152:3300/0 conn(0x7f040c070c60 0x7f040c0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 -- 172.21.15.113:0/1608569192 >> 172.21.15.113:0/1608569192 conn(0x7f040c0ce350 msgr2=0x7f040c0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 -- 172.21.15.113:0/1608569192 shutdown_connections 2024-02-26T12:19:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.842+0000 7f0413784640 1 -- 172.21.15.113:0/1608569192 wait complete. 2024-02-26T12:19:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.843+0000 7f0413784640 1 Processor -- start 2024-02-26T12:19:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 -- start start 2024-02-26T12:19:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040c070c60 0x7f040c0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15db00 0x7f040c0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c06c2d0 con 0x7f040c15dee0 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c06c150 con 0x7f040c070c60 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0413784640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0cc5f0 con 0x7f040c15db00 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0411d21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0411d21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38476/0 (socket says 172.21.15.113:38476) 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0411d21640 1 -- 172.21.15.113:0/1464994306 learned_addr learned my addr 172.21.15.113:0/1464994306 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0411520640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040c070c60 0x7f040c0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.844+0000 7f0410d1f640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15db00 0x7f040c0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 -- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15db00 msgr2=0x7f040c0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15db00 0x7f040c0c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 -- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040c070c60 msgr2=0x7f040c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040c070c60 0x7f040c0c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:25.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 -- 172.21.15.113:0/1464994306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0c83d0 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0411d21640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f040400efc0 tx=0x7f0404009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404018030 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040400cd80 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404003bb0 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c0c5b70 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.845+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c0c7d80 con 0x7f040c15dee0 2024-02-26T12:19:25.833 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.846+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c074a50 con 0x7f040c15dee0 2024-02-26T12:19:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.847+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0404005d10 con 0x7f040c15dee0 2024-02-26T12:19:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.847+0000 7f0401ffb640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 0x7f03f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.847+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f040408a9c0 con 0x7f040c15dee0 2024-02-26T12:19:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.847+0000 7f0411520640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 0x7f03f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:25.834 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.847+0000 7f0411520640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 0x7f03f006d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0408007fd0 tx=0x7f0408007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:25.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:25.851+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f040408ce20 con 0x7f040c15dee0 2024-02-26T12:19:26.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.019+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f040c0b7850 con 0x7f03f006b500 2024-02-26T12:19:26.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.025+0000 7f0401ffb640 1 -- 172.21.15.113:0/1464994306 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251835 (secure 0 0 0) 0x7f040c0b7850 con 0x7f03f006b500 2024-02-26T12:19:26.012 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:26.014 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 msgr2=0x7f03f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 0x7f03f006d9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0408007fd0 tx=0x7f0408007e80 comp rx=0 tx=0).stop 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 msgr2=0x7f040c14b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f040400efc0 tx=0x7f0404009f90 comp rx=0 tx=0).stop 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 shutdown_connections 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f03f006b500 0x7f03f006d9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f040c15dee0 0x7f040c14b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f040c15db00 0x7f040c0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.016 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 --2- 172.21.15.113:0/1464994306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f040c070c60 0x7f040c0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 >> 172.21.15.113:0/1464994306 conn(0x7f040c0ce350 msgr2=0x7f040c15c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 shutdown_connections 2024-02-26T12:19:26.017 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.028+0000 7f0413784640 1 -- 172.21.15.113:0/1464994306 wait complete. 2024-02-26T12:19:26.024 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-26T12:19:25.156761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.712245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933043+0000","last_change":"2024-02-26T12:19:19.469679+0000","last_active":"2024-02-26T12:19:20.933043+0000","last_peered":"2024-02-26T12:19:20.933043+0000","last_clean":"2024-02-26T12:19:20.933043+0000","last_became_active":"2024-02-26T12:19:19.469330+0000","last_became_peered":"2024-02-26T12:19:19.469330+0000","last_unstale":"2024-02-26T12:19:20.933043+0000","last_undegraded":"2024-02-26T12:19:20.933043+0000","last_fullsized":"2024-02-26T12:19:20.933043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449495+0000","last_change":"2024-02-26T12:19:19.464902+0000","last_active":"2024-02-26T12:19:20.449495+0000","last_peered":"2024-02-26T12:19:20.449495+0000","last_clean":"2024-02-26T12:19:20.449495+0000","last_became_active":"2024-02-26T12:19:19.464146+0000","last_became_peered":"2024-02-26T12:19:19.464146+0000","last_unstale":"2024-02-26T12:19:20.449495+0000","last_undegraded":"2024-02-26T12:19:20.449495+0000","last_fullsized":"2024-02-26T12:19:20.449495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933290+0000","last_change":"2024-02-26T12:19:19.455501+0000","last_active":"2024-02-26T12:19:20.933290+0000","last_peered":"2024-02-26T12:19:20.933290+0000","last_clean":"2024-02-26T12:19:20.933290+0000","last_became_active":"2024-02-26T12:19:19.455220+0000","last_became_peered":"2024-02-26T12:19:19.455220+0000","last_unstale":"2024-02-26T12:19:20.933290+0000","last_undegraded":"2024-02-26T12:19:20.933290+0000","last_fullsized":"2024-02-26T12:19:20.933290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:18.000356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452612+0000","last_change":"2024-02-26T12:19:19.463628+0000","last_active":"2024-02-26T12:19:20.452612+0000","last_peered":"2024-02-26T12:19:20.452612+0000","last_clean":"2024-02-26T12:19:20.452612+0000","last_became_active":"2024-02-26T12:19:19.463142+0000","last_became_peered":"2024-02-26T12:19:19.463142+0000","last_unstale":"2024-02-26T12:19:20.452612+0000","last_undegraded":"2024-02-26T12:19:20.452612+0000","last_fullsized":"2024-02-26T12:19:20.452612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932648+0000","last_change":"2024-02-26T12:19:19.474833+0000","last_active":"2024-02-26T12:19:20.932648+0000","last_peered":"2024-02-26T12:19:20.932648+0000","last_clean":"2024-02-26T12:19:20.932648+0000","last_became_active":"2024-02-26T12:19:19.474460+0000","last_became_peered":"2024-02-26T12:19:19.474460+0000","last_unstale":"2024-02-26T12:19:20.932648+0000","last_undegraded":"2024-02-26T12:19:20.932648+0000","last_fullsized":"2024-02-26T12:19:20.932648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452346+0000","last_change":"2024-02-26T12:19:19.465004+0000","last_active":"2024-02-26T12:19:20.452346+0000","last_peered":"2024-02-26T12:19:20.452346+0000","last_clean":"2024-02-26T12:19:20.452346+0000","last_became_active":"2024-02-26T12:19:19.464746+0000","last_became_peered":"2024-02-26T12:19:19.464746+0000","last_unstale":"2024-02-26T12:19:20.452346+0000","last_undegraded":"2024-02-26T12:19:20.452346+0000","last_fullsized":"2024-02-26T12:19:20.452346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932594+0000","last_change":"2024-02-26T12:19:19.472236+0000","last_active":"2024-02-26T12:19:20.932594+0000","last_peered":"2024-02-26T12:19:20.932594+0000","last_clean":"2024-02-26T12:19:20.932594+0000","last_became_active":"2024-02-26T12:19:19.471857+0000","last_became_peered":"2024-02-26T12:19:19.471857+0000","last_unstale":"2024-02-26T12:19:20.932594+0000","last_undegraded":"2024-02-26T12:19:20.932594+0000","last_fullsized":"2024-02-26T12:19:20.932594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932555+0000","last_change":"2024-02-26T12:19:19.471776+0000","last_active":"2024-02-26T12:19:20.932555+0000","last_peered":"2024-02-26T12:19:20.932555+0000","last_clean":"2024-02-26T12:19:20.932555+0000","last_became_active":"2024-02-26T12:19:19.471502+0000","last_became_peered":"2024-02-26T12:19:19.471502+0000","last_unstale":"2024-02-26T12:19:20.932555+0000","last_undegraded":"2024-02-26T12:19:20.932555+0000","last_fullsized":"2024-02-26T12:19:20.932555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933050+0000","last_change":"2024-02-26T12:19:19.477637+0000","last_active":"2024-02-26T12:19:20.933050+0000","last_peered":"2024-02-26T12:19:20.933050+0000","last_clean":"2024-02-26T12:19:20.933050+0000","last_became_active":"2024-02-26T12:19:19.476957+0000","last_became_peered":"2024-02-26T12:19:19.476957+0000","last_unstale":"2024-02-26T12:19:20.933050+0000","last_undegraded":"2024-02-26T12:19:20.933050+0000","last_fullsized":"2024-02-26T12:19:20.933050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:09:58.291307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469618+0000","last_change":"2024-02-26T12:19:19.463237+0000","last_active":"2024-02-26T12:19:20.469618+0000","last_peered":"2024-02-26T12:19:20.469618+0000","last_clean":"2024-02-26T12:19:20.469618+0000","last_became_active":"2024-02-26T12:19:19.462923+0000","last_became_peered":"2024-02-26T12:19:19.462923+0000","last_unstale":"2024-02-26T12:19:20.469618+0000","last_undegraded":"2024-02-26T12:19:20.469618+0000","last_fullsized":"2024-02-26T12:19:20.469618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469534+0000","last_change":"2024-02-26T12:19:19.469387+0000","last_active":"2024-02-26T12:19:20.469534+0000","last_peered":"2024-02-26T12:19:20.469534+0000","last_clean":"2024-02-26T12:19:20.469534+0000","last_became_active":"2024-02-26T12:19:19.469106+0000","last_became_peered":"2024-02-26T12:19:19.469106+0000","last_unstale":"2024-02-26T12:19:20.469534+0000","last_undegraded":"2024-02-26T12:19:20.469534+0000","last_fullsized":"2024-02-26T12:19:20.469534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453265+0000","last_change":"2024-02-26T12:19:19.462424+0000","last_active":"2024-02-26T12:19:20.453265+0000","last_peered":"2024-02-26T12:19:20.453265+0000","last_clean":"2024-02-26T12:19:20.453265+0000","last_became_active":"2024-02-26T12:19:19.462155+0000","last_became_peered":"2024-02-26T12:19:19.462155+0000","last_unstale":"2024-02-26T12:19:20.453265+0000","last_undegraded":"2024-02-26T12:19:20.453265+0000","last_fullsized":"2024-02-26T12:19:20.453265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932944+0000","last_change":"2024-02-26T12:19:19.468734+0000","last_active":"2024-02-26T12:19:20.932944+0000","last_peered":"2024-02-26T12:19:20.932944+0000","last_clean":"2024-02-26T12:19:20.932944+0000","last_became_active":"2024-02-26T12:19:19.468362+0000","last_became_peered":"2024-02-26T12:19:19.468362+0000","last_unstale":"2024-02-26T12:19:20.932944+0000","last_undegraded":"2024-02-26T12:19:20.932944+0000","last_fullsized":"2024-02-26T12:19:20.932944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933218+0000","last_change":"2024-02-26T12:19:19.458457+0000","last_active":"2024-02-26T12:19:20.933218+0000","last_peered":"2024-02-26T12:19:20.933218+0000","last_clean":"2024-02-26T12:19:20.933218+0000","last_became_active":"2024-02-26T12:19:19.458167+0000","last_became_peered":"2024-02-26T12:19:19.458167+0000","last_unstale":"2024-02-26T12:19:20.933218+0000","last_undegraded":"2024-02-26T12:19:20.933218+0000","last_fullsized":"2024-02-26T12:19:20.933218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:34:16.814402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449347+0000","last_change":"2024-02-26T12:19:19.457554+0000","last_active":"2024-02-26T12:19:20.449347+0000","last_peered":"2024-02-26T12:19:20.449347+0000","last_clean":"2024-02-26T12:19:20.449347+0000","last_became_active":"2024-02-26T12:19:19.457255+0000","last_became_peered":"2024-02-26T12:19:19.457255+0000","last_unstale":"2024-02-26T12:19:20.449347+0000","last_undegraded":"2024-02-26T12:19:20.449347+0000","last_fullsized":"2024-02-26T12:19:20.449347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452064+0000","last_change":"2024-02-26T12:19:19.454291+0000","last_active":"2024-02-26T12:19:20.452064+0000","last_peered":"2024-02-26T12:19:20.452064+0000","last_clean":"2024-02-26T12:19:20.452064+0000","last_became_active":"2024-02-26T12:19:19.454008+0000","last_became_peered":"2024-02-26T12:19:19.454008+0000","last_unstale":"2024-02-26T12:19:20.452064+0000","last_undegraded":"2024-02-26T12:19:20.452064+0000","last_fullsized":"2024-02-26T12:19:20.452064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453519+0000","last_change":"2024-02-26T12:19:19.470053+0000","last_active":"2024-02-26T12:19:20.453519+0000","last_peered":"2024-02-26T12:19:20.453519+0000","last_clean":"2024-02-26T12:19:20.453519+0000","last_became_active":"2024-02-26T12:19:19.469775+0000","last_became_peered":"2024-02-26T12:19:19.469775+0000","last_unstale":"2024-02-26T12:19:20.453519+0000","last_undegraded":"2024-02-26T12:19:20.453519+0000","last_fullsized":"2024-02-26T12:19:20.453519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932459+0000","last_change":"2024-02-26T12:19:19.467381+0000","last_active":"2024-02-26T12:19:20.932459+0000","last_peered":"2024-02-26T12:19:20.932459+0000","last_clean":"2024-02-26T12:19:20.932459+0000","last_became_active":"2024-02-26T12:19:19.467003+0000","last_became_peered":"2024-02-26T12:19:19.467003+0000","last_unstale":"2024-02-26T12:19:20.932459+0000","last_undegraded":"2024-02-26T12:19:20.932459+0000","last_fullsized":"2024-02-26T12:19:20.932459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932943+0000","last_change":"2024-02-26T12:19:19.472512+0000","last_active":"2024-02-26T12:19:20.932943+0000","last_peered":"2024-02-26T12:19:20.932943+0000","last_clean":"2024-02-26T12:19:20.932943+0000","last_became_active":"2024-02-26T12:19:19.472179+0000","last_became_peered":"2024-02-26T12:19:19.472179+0000","last_unstale":"2024-02-26T12:19:20.932943+0000","last_undegraded":"2024-02-26T12:19:20.932943+0000","last_fullsized":"2024-02-26T12:19:20.932943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469423+0000","last_change":"2024-02-26T12:19:19.458929+0000","last_active":"2024-02-26T12:19:20.469423+0000","last_peered":"2024-02-26T12:19:20.469423+0000","last_clean":"2024-02-26T12:19:20.469423+0000","last_became_active":"2024-02-26T12:19:19.458670+0000","last_became_peered":"2024-02-26T12:19:19.458670+0000","last_unstale":"2024-02-26T12:19:20.469423+0000","last_undegraded":"2024-02-26T12:19:20.469423+0000","last_fullsized":"2024-02-26T12:19:20.469423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933262+0000","last_change":"2024-02-26T12:19:19.474768+0000","last_active":"2024-02-26T12:19:20.933262+0000","last_peered":"2024-02-26T12:19:20.933262+0000","last_clean":"2024-02-26T12:19:20.933262+0000","last_became_active":"2024-02-26T12:19:19.474509+0000","last_became_peered":"2024-02-26T12:19:19.474509+0000","last_unstale":"2024-02-26T12:19:20.933262+0000","last_undegraded":"2024-02-26T12:19:20.933262+0000","last_fullsized":"2024-02-26T12:19:20.933262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:18:43.353358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452428+0000","last_change":"2024-02-26T12:19:19.469403+0000","last_active":"2024-02-26T12:19:20.452428+0000","last_peered":"2024-02-26T12:19:20.452428+0000","last_clean":"2024-02-26T12:19:20.452428+0000","last_became_active":"2024-02-26T12:19:19.469137+0000","last_became_peered":"2024-02-26T12:19:19.469137+0000","last_unstale":"2024-02-26T12:19:20.452428+0000","last_undegraded":"2024-02-26T12:19:20.452428+0000","last_fullsized":"2024-02-26T12:19:20.452428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932447+0000","last_change":"2024-02-26T12:19:19.459664+0000","last_active":"2024-02-26T12:19:20.932447+0000","last_peered":"2024-02-26T12:19:20.932447+0000","last_clean":"2024-02-26T12:19:20.932447+0000","last_became_active":"2024-02-26T12:19:19.459409+0000","last_became_peered":"2024-02-26T12:19:19.459409+0000","last_unstale":"2024-02-26T12:19:20.932447+0000","last_undegraded":"2024-02-26T12:19:20.932447+0000","last_fullsized":"2024-02-26T12:19:20.932447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452126+0000","last_change":"2024-02-26T12:19:19.465721+0000","last_active":"2024-02-26T12:19:20.452126+0000","last_peered":"2024-02-26T12:19:20.452126+0000","last_clean":"2024-02-26T12:19:20.452126+0000","last_became_active":"2024-02-26T12:19:19.465390+0000","last_became_peered":"2024-02-26T12:19:19.465390+0000","last_unstale":"2024-02-26T12:19:20.452126+0000","last_undegraded":"2024-02-26T12:19:20.452126+0000","last_fullsized":"2024-02-26T12:19:20.452126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932702+0000","last_change":"2024-02-26T12:19:19.461546+0000","last_active":"2024-02-26T12:19:20.932702+0000","last_peered":"2024-02-26T12:19:20.932702+0000","last_clean":"2024-02-26T12:19:20.932702+0000","last_became_active":"2024-02-26T12:19:19.461235+0000","last_became_peered":"2024-02-26T12:19:19.461235+0000","last_unstale":"2024-02-26T12:19:20.932702+0000","last_undegraded":"2024-02-26T12:19:20.932702+0000","last_fullsized":"2024-02-26T12:19:20.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469664+0000","last_change":"2024-02-26T12:19:19.470118+0000","last_active":"2024-02-26T12:19:20.469664+0000","last_peered":"2024-02-26T12:19:20.469664+0000","last_clean":"2024-02-26T12:19:20.469664+0000","last_became_active":"2024-02-26T12:19:19.469859+0000","last_became_peered":"2024-02-26T12:19:19.469859+0000","last_unstale":"2024-02-26T12:19:20.469664+0000","last_undegraded":"2024-02-26T12:19:20.469664+0000","last_fullsized":"2024-02-26T12:19:20.469664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449593+0000","last_change":"2024-02-26T12:19:19.461901+0000","last_active":"2024-02-26T12:19:20.449593+0000","last_peered":"2024-02-26T12:19:20.449593+0000","last_clean":"2024-02-26T12:19:20.449593+0000","last_became_active":"2024-02-26T12:19:19.461611+0000","last_became_peered":"2024-02-26T12:19:19.461611+0000","last_unstale":"2024-02-26T12:19:20.449593+0000","last_undegraded":"2024-02-26T12:19:20.449593+0000","last_fullsized":"2024-02-26T12:19:20.449593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.466246+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.465853+0000","last_became_peered":"2024-02-26T12:19:19.465853+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933418+0000","last_change":"2024-02-26T12:19:19.462596+0000","last_active":"2024-02-26T12:19:20.933418+0000","last_peered":"2024-02-26T12:19:20.933418+0000","last_clean":"2024-02-26T12:19:20.933418+0000","last_became_active":"2024-02-26T12:19:19.462151+0000","last_became_peered":"2024-02-26T12:19:19.462151+0000","last_unstale":"2024-02-26T12:19:20.933418+0000","last_undegraded":"2024-02-26T12:19:20.933418+0000","last_fullsized":"2024-02-26T12:19:20.933418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452517+0000","last_change":"2024-02-26T12:19:19.463840+0000","last_active":"2024-02-26T12:19:20.452517+0000","last_peered":"2024-02-26T12:19:20.452517+0000","last_clean":"2024-02-26T12:19:20.452517+0000","last_became_active":"2024-02-26T12:19:19.462936+0000","last_became_peered":"2024-02-26T12:19:19.462936+0000","last_unstale":"2024-02-26T12:19:20.452517+0000","last_undegraded":"2024-02-26T12:19:20.452517+0000","last_fullsized":"2024-02-26T12:19:20.452517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932299+0000","last_change":"2024-02-26T12:19:19.463407+0000","last_active":"2024-02-26T12:19:20.932299+0000","last_peered":"2024-02-26T12:19:20.932299+0000","last_clean":"2024-02-26T12:19:20.932299+0000","last_became_active":"2024-02-26T12:19:19.463126+0000","last_became_peered":"2024-02-26T12:19:19.463126+0000","last_unstale":"2024-02-26T12:19:20.932299+0000","last_undegraded":"2024-02-26T12:19:20.932299+0000","last_fullsized":"2024-02-26T12:19:20.932299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469300+0000","last_change":"2024-02-26T12:19:19.466527+0000","last_active":"2024-02-26T12:19:20.469300+0000","last_peered":"2024-02-26T12:19:20.469300+0000","last_clean":"2024-02-26T12:19:20.469300+0000","last_became_active":"2024-02-26T12:19:19.466230+0000","last_became_peered":"2024-02-26T12:19:19.466230+0000","last_unstale":"2024-02-26T12:19:20.469300+0000","last_undegraded":"2024-02-26T12:19:20.469300+0000","last_fullsized":"2024-02-26T12:19:20.469300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453228+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.453228+0000","last_peered":"2024-02-26T12:19:20.453228+0000","last_clean":"2024-02-26T12:19:20.453228+0000","last_became_active":"2024-02-26T12:19:19.458585+0000","last_became_peered":"2024-02-26T12:19:19.458585+0000","last_unstale":"2024-02-26T12:19:20.453228+0000","last_undegraded":"2024-02-26T12:19:20.453228+0000","last_fullsized":"2024-02-26T12:19:20.453228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932859+0000","last_change":"2024-02-26T12:19:18.462238+0000","last_active":"2024-02-26T12:19:20.932859+0000","last_peered":"2024-02-26T12:19:20.932859+0000","last_clean":"2024-02-26T12:19:20.932859+0000","last_became_active":"2024-02-26T12:19:18.461454+0000","last_became_peered":"2024-02-26T12:19:18.461454+0000","last_unstale":"2024-02-26T12:19:20.932859+0000","last_undegraded":"2024-02-26T12:19:20.932859+0000","last_fullsized":"2024-02-26T12:19:20.932859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933404+0000","last_change":"2024-02-26T12:19:19.454565+0000","last_active":"2024-02-26T12:19:20.933404+0000","last_peered":"2024-02-26T12:19:20.933404+0000","last_clean":"2024-02-26T12:19:20.933404+0000","last_became_active":"2024-02-26T12:19:19.454147+0000","last_became_peered":"2024-02-26T12:19:19.454147+0000","last_unstale":"2024-02-26T12:19:20.933404+0000","last_undegraded":"2024-02-26T12:19:20.933404+0000","last_fullsized":"2024-02-26T12:19:20.933404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469231+0000","last_change":"2024-02-26T12:19:18.462539+0000","last_active":"2024-02-26T12:19:20.469231+0000","last_peered":"2024-02-26T12:19:20.469231+0000","last_clean":"2024-02-26T12:19:20.469231+0000","last_became_active":"2024-02-26T12:19:18.462256+0000","last_became_peered":"2024-02-26T12:19:18.462256+0000","last_unstale":"2024-02-26T12:19:20.469231+0000","last_undegraded":"2024-02-26T12:19:20.469231+0000","last_fullsized":"2024-02-26T12:19:20.469231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932590+0000","last_change":"2024-02-26T12:19:18.463188+0000","last_active":"2024-02-26T12:19:20.932590+0000","last_peered":"2024-02-26T12:19:20.932590+0000","last_clean":"2024-02-26T12:19:20.932590+0000","last_became_active":"2024-02-26T12:19:18.462775+0000","last_became_peered":"2024-02-26T12:19:18.462775+0000","last_unstale":"2024-02-26T12:19:20.932590+0000","last_undegraded":"2024-02-26T12:19:20.932590+0000","last_fullsized":"2024-02-26T12:19:20.932590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932747+0000","last_change":"2024-02-26T12:19:19.462308+0000","last_active":"2024-02-26T12:19:20.932747+0000","last_peered":"2024-02-26T12:19:20.932747+0000","last_clean":"2024-02-26T12:19:20.932747+0000","last_became_active":"2024-02-26T12:19:19.462011+0000","last_became_peered":"2024-02-26T12:19:19.462011+0000","last_unstale":"2024-02-26T12:19:20.932747+0000","last_undegraded":"2024-02-26T12:19:20.932747+0000","last_fullsized":"2024-02-26T12:19:20.932747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452209+0000","last_change":"2024-02-26T12:19:18.456487+0000","last_active":"2024-02-26T12:19:20.452209+0000","last_peered":"2024-02-26T12:19:20.452209+0000","last_clean":"2024-02-26T12:19:20.452209+0000","last_became_active":"2024-02-26T12:19:18.456207+0000","last_became_peered":"2024-02-26T12:19:18.456207+0000","last_unstale":"2024-02-26T12:19:20.452209+0000","last_undegraded":"2024-02-26T12:19:20.452209+0000","last_fullsized":"2024-02-26T12:19:20.452209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449517+0000","last_change":"2024-02-26T12:19:19.460550+0000","last_active":"2024-02-26T12:19:20.449517+0000","last_peered":"2024-02-26T12:19:20.449517+0000","last_clean":"2024-02-26T12:19:20.449517+0000","last_became_active":"2024-02-26T12:19:19.460265+0000","last_became_peered":"2024-02-26T12:19:19.460265+0000","last_unstale":"2024-02-26T12:19:20.449517+0000","last_undegraded":"2024-02-26T12:19:20.449517+0000","last_fullsized":"2024-02-26T12:19:20.449517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469567+0000","last_change":"2024-02-26T12:19:18.464033+0000","last_active":"2024-02-26T12:19:20.469567+0000","last_peered":"2024-02-26T12:19:20.469567+0000","last_clean":"2024-02-26T12:19:20.469567+0000","last_became_active":"2024-02-26T12:19:18.463599+0000","last_became_peered":"2024-02-26T12:19:18.463599+0000","last_unstale":"2024-02-26T12:19:20.469567+0000","last_undegraded":"2024-02-26T12:19:20.469567+0000","last_fullsized":"2024-02-26T12:19:20.469567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453466+0000","last_change":"2024-02-26T12:19:19.476744+0000","last_active":"2024-02-26T12:19:20.453466+0000","last_peered":"2024-02-26T12:19:20.453466+0000","last_clean":"2024-02-26T12:19:20.453466+0000","last_became_active":"2024-02-26T12:19:19.476456+0000","last_became_peered":"2024-02-26T12:19:19.476456+0000","last_unstale":"2024-02-26T12:19:20.453466+0000","last_undegraded":"2024-02-26T12:19:20.453466+0000","last_fullsized":"2024-02-26T12:19:20.453466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453526+0000","last_change":"2024-02-26T12:19:18.461181+0000","last_active":"2024-02-26T12:19:20.453526+0000","last_peered":"2024-02-26T12:19:20.453526+0000","last_clean":"2024-02-26T12:19:20.453526+0000","last_became_active":"2024-02-26T12:19:18.460919+0000","last_became_peered":"2024-02-26T12:19:18.460919+0000","last_unstale":"2024-02-26T12:19:20.453526+0000","last_undegraded":"2024-02-26T12:19:20.453526+0000","last_fullsized":"2024-02-26T12:19:20.453526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933451+0000","last_change":"2024-02-26T12:19:19.456644+0000","last_active":"2024-02-26T12:19:20.933451+0000","last_peered":"2024-02-26T12:19:20.933451+0000","last_clean":"2024-02-26T12:19:20.933451+0000","last_became_active":"2024-02-26T12:19:19.456368+0000","last_became_peered":"2024-02-26T12:19:19.456368+0000","last_unstale":"2024-02-26T12:19:20.933451+0000","last_undegraded":"2024-02-26T12:19:20.933451+0000","last_fullsized":"2024-02-26T12:19:20.933451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449625+0000","last_change":"2024-02-26T12:19:18.461795+0000","last_active":"2024-02-26T12:19:20.449625+0000","last_peered":"2024-02-26T12:19:20.449625+0000","last_clean":"2024-02-26T12:19:20.449625+0000","last_became_active":"2024-02-26T12:19:18.460734+0000","last_became_peered":"2024-02-26T12:19:18.460734+0000","last_unstale":"2024-02-26T12:19:20.449625+0000","last_undegraded":"2024-02-26T12:19:20.449625+0000","last_fullsized":"2024-02-26T12:19:20.449625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453339+0000","last_change":"2024-02-26T12:19:19.466977+0000","last_active":"2024-02-26T12:19:20.453339+0000","last_peered":"2024-02-26T12:19:20.453339+0000","last_clean":"2024-02-26T12:19:20.453339+0000","last_became_active":"2024-02-26T12:19:19.466691+0000","last_became_peered":"2024-02-26T12:19:19.466691+0000","last_unstale":"2024-02-26T12:19:20.453339+0000","last_undegraded":"2024-02-26T12:19:20.453339+0000","last_fullsized":"2024-02-26T12:19:20.453339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:36.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469361+0000","last_change":"2024-02-26T12:19:18.464762+0000","last_active":"2024-02-26T12:19:20.469361+0000","last_peered":"2024-02-26T12:19:20.469361+0000","last_clean":"2024-02-26T12:19:20.469361+0000","last_became_active":"2024-02-26T12:19:18.464498+0000","last_became_peered":"2024-02-26T12:19:18.464498+0000","last_unstale":"2024-02-26T12:19:20.469361+0000","last_undegraded":"2024-02-26T12:19:20.469361+0000","last_fullsized":"2024-02-26T12:19:20.469361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932633+0000","last_change":"2024-02-26T12:19:19.470554+0000","last_active":"2024-02-26T12:19:20.932633+0000","last_peered":"2024-02-26T12:19:20.932633+0000","last_clean":"2024-02-26T12:19:20.932633+0000","last_became_active":"2024-02-26T12:19:19.470255+0000","last_became_peered":"2024-02-26T12:19:19.470255+0000","last_unstale":"2024-02-26T12:19:20.932633+0000","last_undegraded":"2024-02-26T12:19:20.932633+0000","last_fullsized":"2024-02-26T12:19:20.932633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933472+0000","last_change":"2024-02-26T12:19:18.460695+0000","last_active":"2024-02-26T12:19:20.933472+0000","last_peered":"2024-02-26T12:19:20.933472+0000","last_clean":"2024-02-26T12:19:20.933472+0000","last_became_active":"2024-02-26T12:19:18.460421+0000","last_became_peered":"2024-02-26T12:19:18.460421+0000","last_unstale":"2024-02-26T12:19:20.933472+0000","last_undegraded":"2024-02-26T12:19:20.933472+0000","last_fullsized":"2024-02-26T12:19:20.933472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:43:36.801064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933177+0000","last_change":"2024-02-26T12:19:19.474064+0000","last_active":"2024-02-26T12:19:20.933177+0000","last_peered":"2024-02-26T12:19:20.933177+0000","last_clean":"2024-02-26T12:19:20.933177+0000","last_became_active":"2024-02-26T12:19:19.473790+0000","last_became_peered":"2024-02-26T12:19:19.473790+0000","last_unstale":"2024-02-26T12:19:20.933177+0000","last_undegraded":"2024-02-26T12:19:20.933177+0000","last_fullsized":"2024-02-26T12:19:20.933177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:25.284013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452545+0000","last_change":"2024-02-26T12:19:18.455061+0000","last_active":"2024-02-26T12:19:20.452545+0000","last_peered":"2024-02-26T12:19:20.452545+0000","last_clean":"2024-02-26T12:19:20.452545+0000","last_became_active":"2024-02-26T12:19:18.454770+0000","last_became_peered":"2024-02-26T12:19:18.454770+0000","last_unstale":"2024-02-26T12:19:20.452545+0000","last_undegraded":"2024-02-26T12:19:20.452545+0000","last_fullsized":"2024-02-26T12:19:20.452545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932700+0000","last_change":"2024-02-26T12:19:19.477159+0000","last_active":"2024-02-26T12:19:20.932700+0000","last_peered":"2024-02-26T12:19:20.932700+0000","last_clean":"2024-02-26T12:19:20.932700+0000","last_became_active":"2024-02-26T12:19:19.476899+0000","last_became_peered":"2024-02-26T12:19:19.476899+0000","last_unstale":"2024-02-26T12:19:20.932700+0000","last_undegraded":"2024-02-26T12:19:20.932700+0000","last_fullsized":"2024-02-26T12:19:20.932700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469219+0000","last_change":"2024-02-26T12:19:18.463068+0000","last_active":"2024-02-26T12:19:20.469219+0000","last_peered":"2024-02-26T12:19:20.469219+0000","last_clean":"2024-02-26T12:19:20.469219+0000","last_became_active":"2024-02-26T12:19:18.462586+0000","last_became_peered":"2024-02-26T12:19:18.462586+0000","last_unstale":"2024-02-26T12:19:20.469219+0000","last_undegraded":"2024-02-26T12:19:20.469219+0000","last_fullsized":"2024-02-26T12:19:20.469219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469287+0000","last_change":"2024-02-26T12:19:19.465821+0000","last_active":"2024-02-26T12:19:20.469287+0000","last_peered":"2024-02-26T12:19:20.469287+0000","last_clean":"2024-02-26T12:19:20.469287+0000","last_became_active":"2024-02-26T12:19:19.465294+0000","last_became_peered":"2024-02-26T12:19:19.465294+0000","last_unstale":"2024-02-26T12:19:20.469287+0000","last_undegraded":"2024-02-26T12:19:20.469287+0000","last_fullsized":"2024-02-26T12:19:20.469287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932061+0000","last_change":"2024-02-26T12:19:18.461135+0000","last_active":"2024-02-26T12:19:20.932061+0000","last_peered":"2024-02-26T12:19:20.932061+0000","last_clean":"2024-02-26T12:19:20.932061+0000","last_became_active":"2024-02-26T12:19:18.460849+0000","last_became_peered":"2024-02-26T12:19:18.460849+0000","last_unstale":"2024-02-26T12:19:20.932061+0000","last_undegraded":"2024-02-26T12:19:20.932061+0000","last_fullsized":"2024-02-26T12:19:20.932061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:55:52.430631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.473888+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.473207+0000","last_became_peered":"2024-02-26T12:19:19.473207+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453157+0000","last_change":"2024-02-26T12:19:18.461104+0000","last_active":"2024-02-26T12:19:20.453157+0000","last_peered":"2024-02-26T12:19:20.453157+0000","last_clean":"2024-02-26T12:19:20.453157+0000","last_became_active":"2024-02-26T12:19:18.460836+0000","last_became_peered":"2024-02-26T12:19:18.460836+0000","last_unstale":"2024-02-26T12:19:20.453157+0000","last_undegraded":"2024-02-26T12:19:20.453157+0000","last_fullsized":"2024-02-26T12:19:20.453157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:47:30.665043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932927+0000","last_change":"2024-02-26T12:19:19.470461+0000","last_active":"2024-02-26T12:19:20.932927+0000","last_peered":"2024-02-26T12:19:20.932927+0000","last_clean":"2024-02-26T12:19:20.932927+0000","last_became_active":"2024-02-26T12:19:19.470152+0000","last_became_peered":"2024-02-26T12:19:19.470152+0000","last_unstale":"2024-02-26T12:19:20.932927+0000","last_undegraded":"2024-02-26T12:19:20.932927+0000","last_fullsized":"2024-02-26T12:19:20.932927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932510+0000","last_change":"2024-02-26T12:19:18.455812+0000","last_active":"2024-02-26T12:19:20.932510+0000","last_peered":"2024-02-26T12:19:20.932510+0000","last_clean":"2024-02-26T12:19:20.932510+0000","last_became_active":"2024-02-26T12:19:18.455182+0000","last_became_peered":"2024-02-26T12:19:18.455182+0000","last_unstale":"2024-02-26T12:19:20.932510+0000","last_undegraded":"2024-02-26T12:19:20.932510+0000","last_fullsized":"2024-02-26T12:19:20.932510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933136+0000","last_change":"2024-02-26T12:19:19.477606+0000","last_active":"2024-02-26T12:19:20.933136+0000","last_peered":"2024-02-26T12:19:20.933136+0000","last_clean":"2024-02-26T12:19:20.933136+0000","last_became_active":"2024-02-26T12:19:19.477293+0000","last_became_peered":"2024-02-26T12:19:19.477293+0000","last_unstale":"2024-02-26T12:19:20.933136+0000","last_undegraded":"2024-02-26T12:19:20.933136+0000","last_fullsized":"2024-02-26T12:19:20.933136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:07.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449697+0000","last_change":"2024-02-26T12:19:18.461425+0000","last_active":"2024-02-26T12:19:20.449697+0000","last_peered":"2024-02-26T12:19:20.449697+0000","last_clean":"2024-02-26T12:19:20.449697+0000","last_became_active":"2024-02-26T12:19:18.461141+0000","last_became_peered":"2024-02-26T12:19:18.461141+0000","last_unstale":"2024-02-26T12:19:20.449697+0000","last_undegraded":"2024-02-26T12:19:20.449697+0000","last_fullsized":"2024-02-26T12:19:20.449697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452805+0000","last_change":"2024-02-26T12:19:19.462834+0000","last_active":"2024-02-26T12:19:20.452805+0000","last_peered":"2024-02-26T12:19:20.452805+0000","last_clean":"2024-02-26T12:19:20.452805+0000","last_became_active":"2024-02-26T12:19:19.462465+0000","last_became_peered":"2024-02-26T12:19:19.462465+0000","last_unstale":"2024-02-26T12:19:20.452805+0000","last_undegraded":"2024-02-26T12:19:20.452805+0000","last_fullsized":"2024-02-26T12:19:20.452805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932370+0000","last_change":"2024-02-26T12:19:18.456646+0000","last_active":"2024-02-26T12:19:20.932370+0000","last_peered":"2024-02-26T12:19:20.932370+0000","last_clean":"2024-02-26T12:19:20.932370+0000","last_became_active":"2024-02-26T12:19:18.456316+0000","last_became_peered":"2024-02-26T12:19:18.456316+0000","last_unstale":"2024-02-26T12:19:20.932370+0000","last_undegraded":"2024-02-26T12:19:20.932370+0000","last_fullsized":"2024-02-26T12:19:20.932370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:15:21.737677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932817+0000","last_change":"2024-02-26T12:19:19.469817+0000","last_active":"2024-02-26T12:19:20.932817+0000","last_peered":"2024-02-26T12:19:20.932817+0000","last_clean":"2024-02-26T12:19:20.932817+0000","last_became_active":"2024-02-26T12:19:19.469355+0000","last_became_peered":"2024-02-26T12:19:19.469355+0000","last_unstale":"2024-02-26T12:19:20.932817+0000","last_undegraded":"2024-02-26T12:19:20.932817+0000","last_fullsized":"2024-02-26T12:19:20.932817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932422+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:19:20.932422+0000","last_peered":"2024-02-26T12:19:20.932422+0000","last_clean":"2024-02-26T12:19:20.932422+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:19:20.932422+0000","last_undegraded":"2024-02-26T12:19:20.932422+0000","last_fullsized":"2024-02-26T12:19:20.932422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452184+0000","last_change":"2024-02-26T12:19:18.456266+0000","last_active":"2024-02-26T12:19:20.452184+0000","last_peered":"2024-02-26T12:19:20.452184+0000","last_clean":"2024-02-26T12:19:20.452184+0000","last_became_active":"2024-02-26T12:19:18.455942+0000","last_became_peered":"2024-02-26T12:19:18.455942+0000","last_unstale":"2024-02-26T12:19:20.452184+0000","last_undegraded":"2024-02-26T12:19:20.452184+0000","last_fullsized":"2024-02-26T12:19:20.452184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933368+0000","last_change":"2024-02-26T12:19:19.470887+0000","last_active":"2024-02-26T12:19:20.933368+0000","last_peered":"2024-02-26T12:19:20.933368+0000","last_clean":"2024-02-26T12:19:20.933368+0000","last_became_active":"2024-02-26T12:19:19.470607+0000","last_became_peered":"2024-02-26T12:19:19.470607+0000","last_unstale":"2024-02-26T12:19:20.933368+0000","last_undegraded":"2024-02-26T12:19:20.933368+0000","last_fullsized":"2024-02-26T12:19:20.933368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932456+0000","last_change":"2024-02-26T12:19:18.465038+0000","last_active":"2024-02-26T12:19:20.932456+0000","last_peered":"2024-02-26T12:19:20.932456+0000","last_clean":"2024-02-26T12:19:20.932456+0000","last_became_active":"2024-02-26T12:19:18.464586+0000","last_became_peered":"2024-02-26T12:19:18.464586+0000","last_unstale":"2024-02-26T12:19:20.932456+0000","last_undegraded":"2024-02-26T12:19:20.932456+0000","last_fullsized":"2024-02-26T12:19:20.932456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932968+0000","last_change":"2024-02-26T12:19:19.453339+0000","last_active":"2024-02-26T12:19:20.932968+0000","last_peered":"2024-02-26T12:19:20.932968+0000","last_clean":"2024-02-26T12:19:20.932968+0000","last_became_active":"2024-02-26T12:19:19.453031+0000","last_became_peered":"2024-02-26T12:19:19.453031+0000","last_unstale":"2024-02-26T12:19:20.932968+0000","last_undegraded":"2024-02-26T12:19:20.932968+0000","last_fullsized":"2024-02-26T12:19:20.932968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932171+0000","last_change":"2024-02-26T12:19:18.455546+0000","last_active":"2024-02-26T12:19:20.932171+0000","last_peered":"2024-02-26T12:19:20.932171+0000","last_clean":"2024-02-26T12:19:20.932171+0000","last_became_active":"2024-02-26T12:19:18.455214+0000","last_became_peered":"2024-02-26T12:19:18.455214+0000","last_unstale":"2024-02-26T12:19:20.932171+0000","last_undegraded":"2024-02-26T12:19:20.932171+0000","last_fullsized":"2024-02-26T12:19:20.932171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449348+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.449348+0000","last_peered":"2024-02-26T12:19:20.449348+0000","last_clean":"2024-02-26T12:19:20.449348+0000","last_became_active":"2024-02-26T12:19:19.458568+0000","last_became_peered":"2024-02-26T12:19:19.458568+0000","last_unstale":"2024-02-26T12:19:20.449348+0000","last_undegraded":"2024-02-26T12:19:20.449348+0000","last_fullsized":"2024-02-26T12:19:20.449348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452642+0000","last_change":"2024-02-26T12:19:18.462392+0000","last_active":"2024-02-26T12:19:20.452642+0000","last_peered":"2024-02-26T12:19:20.452642+0000","last_clean":"2024-02-26T12:19:20.452642+0000","last_became_active":"2024-02-26T12:19:18.462102+0000","last_became_peered":"2024-02-26T12:19:18.462102+0000","last_unstale":"2024-02-26T12:19:20.452642+0000","last_undegraded":"2024-02-26T12:19:20.452642+0000","last_fullsized":"2024-02-26T12:19:20.452642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453404+0000","last_change":"2024-02-26T12:19:19.457056+0000","last_active":"2024-02-26T12:19:20.453404+0000","last_peered":"2024-02-26T12:19:20.453404+0000","last_clean":"2024-02-26T12:19:20.453404+0000","last_became_active":"2024-02-26T12:19:19.456475+0000","last_became_peered":"2024-02-26T12:19:19.456475+0000","last_unstale":"2024-02-26T12:19:20.453404+0000","last_undegraded":"2024-02-26T12:19:20.453404+0000","last_fullsized":"2024-02-26T12:19:20.453404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449511+0000","last_change":"2024-02-26T12:19:18.460143+0000","last_active":"2024-02-26T12:19:20.449511+0000","last_peered":"2024-02-26T12:19:20.449511+0000","last_clean":"2024-02-26T12:19:20.449511+0000","last_became_active":"2024-02-26T12:19:18.459858+0000","last_became_peered":"2024-02-26T12:19:18.459858+0000","last_unstale":"2024-02-26T12:19:20.449511+0000","last_undegraded":"2024-02-26T12:19:20.449511+0000","last_fullsized":"2024-02-26T12:19:20.449511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453144+0000","last_change":"2024-02-26T12:19:19.462914+0000","last_active":"2024-02-26T12:19:20.453144+0000","last_peered":"2024-02-26T12:19:20.453144+0000","last_clean":"2024-02-26T12:19:20.453144+0000","last_became_active":"2024-02-26T12:19:19.462335+0000","last_became_peered":"2024-02-26T12:19:19.462335+0000","last_unstale":"2024-02-26T12:19:20.453144+0000","last_undegraded":"2024-02-26T12:19:20.453144+0000","last_fullsized":"2024-02-26T12:19:20.453144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932953+0000","last_change":"2024-02-26T12:19:18.464084+0000","last_active":"2024-02-26T12:19:20.932953+0000","last_peered":"2024-02-26T12:19:20.932953+0000","last_clean":"2024-02-26T12:19:20.932953+0000","last_became_active":"2024-02-26T12:19:18.463367+0000","last_became_peered":"2024-02-26T12:19:18.463367+0000","last_unstale":"2024-02-26T12:19:20.932953+0000","last_undegraded":"2024-02-26T12:19:20.932953+0000","last_fullsized":"2024-02-26T12:19:20.932953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449431+0000","last_change":"2024-02-26T12:19:19.461058+0000","last_active":"2024-02-26T12:19:20.449431+0000","last_peered":"2024-02-26T12:19:20.449431+0000","last_clean":"2024-02-26T12:19:20.449431+0000","last_became_active":"2024-02-26T12:19:19.460767+0000","last_became_peered":"2024-02-26T12:19:19.460767+0000","last_unstale":"2024-02-26T12:19:20.449431+0000","last_undegraded":"2024-02-26T12:19:20.449431+0000","last_fullsized":"2024-02-26T12:19:20.449431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.468823+0000","last_change":"2024-02-26T12:19:18.463879+0000","last_active":"2024-02-26T12:19:20.468823+0000","last_peered":"2024-02-26T12:19:20.468823+0000","last_clean":"2024-02-26T12:19:20.468823+0000","last_became_active":"2024-02-26T12:19:18.463588+0000","last_became_peered":"2024-02-26T12:19:18.463588+0000","last_unstale":"2024-02-26T12:19:20.468823+0000","last_undegraded":"2024-02-26T12:19:20.468823+0000","last_fullsized":"2024-02-26T12:19:20.468823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932829+0000","last_change":"2024-02-26T12:19:19.472563+0000","last_active":"2024-02-26T12:19:20.932829+0000","last_peered":"2024-02-26T12:19:20.932829+0000","last_clean":"2024-02-26T12:19:20.932829+0000","last_became_active":"2024-02-26T12:19:19.472300+0000","last_became_peered":"2024-02-26T12:19:19.472300+0000","last_unstale":"2024-02-26T12:19:20.932829+0000","last_undegraded":"2024-02-26T12:19:20.932829+0000","last_fullsized":"2024-02-26T12:19:20.932829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469619+0000","last_change":"2024-02-26T12:19:18.464144+0000","last_active":"2024-02-26T12:19:20.469619+0000","last_peered":"2024-02-26T12:19:20.469619+0000","last_clean":"2024-02-26T12:19:20.469619+0000","last_became_active":"2024-02-26T12:19:18.462912+0000","last_became_peered":"2024-02-26T12:19:18.462912+0000","last_unstale":"2024-02-26T12:19:20.469619+0000","last_undegraded":"2024-02-26T12:19:20.469619+0000","last_fullsized":"2024-02-26T12:19:20.469619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933409+0000","last_change":"2024-02-26T12:19:19.462865+0000","last_active":"2024-02-26T12:19:20.933409+0000","last_peered":"2024-02-26T12:19:20.933409+0000","last_clean":"2024-02-26T12:19:20.933409+0000","last_became_active":"2024-02-26T12:19:19.460986+0000","last_became_peered":"2024-02-26T12:19:19.460986+0000","last_unstale":"2024-02-26T12:19:20.933409+0000","last_undegraded":"2024-02-26T12:19:20.933409+0000","last_fullsized":"2024-02-26T12:19:20.933409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932323+0000","last_change":"2024-02-26T12:19:18.461638+0000","last_active":"2024-02-26T12:19:20.932323+0000","last_peered":"2024-02-26T12:19:20.932323+0000","last_clean":"2024-02-26T12:19:20.932323+0000","last_became_active":"2024-02-26T12:19:18.461352+0000","last_became_peered":"2024-02-26T12:19:18.461352+0000","last_unstale":"2024-02-26T12:19:20.932323+0000","last_undegraded":"2024-02-26T12:19:20.932323+0000","last_fullsized":"2024-02-26T12:19:20.932323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453133+0000","last_change":"2024-02-26T12:19:19.455737+0000","last_active":"2024-02-26T12:19:20.453133+0000","last_peered":"2024-02-26T12:19:20.453133+0000","last_clean":"2024-02-26T12:19:20.453133+0000","last_became_active":"2024-02-26T12:19:19.454845+0000","last_became_peered":"2024-02-26T12:19:19.454845+0000","last_unstale":"2024-02-26T12:19:20.453133+0000","last_undegraded":"2024-02-26T12:19:20.453133+0000","last_fullsized":"2024-02-26T12:19:20.453133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:08.196993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449440+0000","last_change":"2024-02-26T12:19:18.462514+0000","last_active":"2024-02-26T12:19:20.449440+0000","last_peered":"2024-02-26T12:19:20.449440+0000","last_clean":"2024-02-26T12:19:20.449440+0000","last_became_active":"2024-02-26T12:19:18.461749+0000","last_became_peered":"2024-02-26T12:19:18.461749+0000","last_unstale":"2024-02-26T12:19:20.449440+0000","last_undegraded":"2024-02-26T12:19:20.449440+0000","last_fullsized":"2024-02-26T12:19:20.449440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932875+0000","last_change":"2024-02-26T12:19:19.461344+0000","last_active":"2024-02-26T12:19:20.932875+0000","last_peered":"2024-02-26T12:19:20.932875+0000","last_clean":"2024-02-26T12:19:20.932875+0000","last_became_active":"2024-02-26T12:19:19.461069+0000","last_became_peered":"2024-02-26T12:19:19.461069+0000","last_unstale":"2024-02-26T12:19:20.932875+0000","last_undegraded":"2024-02-26T12:19:20.932875+0000","last_fullsized":"2024-02-26T12:19:20.932875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449411+0000","last_change":"2024-02-26T12:19:18.459629+0000","last_active":"2024-02-26T12:19:20.449411+0000","last_peered":"2024-02-26T12:19:20.449411+0000","last_clean":"2024-02-26T12:19:20.449411+0000","last_became_active":"2024-02-26T12:19:18.459350+0000","last_became_peered":"2024-02-26T12:19:18.459350+0000","last_unstale":"2024-02-26T12:19:20.449411+0000","last_undegraded":"2024-02-26T12:19:20.449411+0000","last_fullsized":"2024-02-26T12:19:20.449411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932758+0000","last_change":"2024-02-26T12:19:19.460693+0000","last_active":"2024-02-26T12:19:20.932758+0000","last_peered":"2024-02-26T12:19:20.932758+0000","last_clean":"2024-02-26T12:19:20.932758+0000","last_became_active":"2024-02-26T12:19:19.459680+0000","last_became_peered":"2024-02-26T12:19:19.459680+0000","last_unstale":"2024-02-26T12:19:20.932758+0000","last_undegraded":"2024-02-26T12:19:20.932758+0000","last_fullsized":"2024-02-26T12:19:20.932758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932791+0000","last_change":"2024-02-26T12:19:18.461202+0000","last_active":"2024-02-26T12:19:20.932791+0000","last_peered":"2024-02-26T12:19:20.932791+0000","last_clean":"2024-02-26T12:19:20.932791+0000","last_became_active":"2024-02-26T12:19:18.460874+0000","last_became_peered":"2024-02-26T12:19:18.460874+0000","last_unstale":"2024-02-26T12:19:20.932791+0000","last_undegraded":"2024-02-26T12:19:20.932791+0000","last_fullsized":"2024-02-26T12:19:20.932791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:16.993521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469337+0000","last_change":"2024-02-26T12:19:19.465226+0000","last_active":"2024-02-26T12:19:20.469337+0000","last_peered":"2024-02-26T12:19:20.469337+0000","last_clean":"2024-02-26T12:19:20.469337+0000","last_became_active":"2024-02-26T12:19:19.464959+0000","last_became_peered":"2024-02-26T12:19:19.464959+0000","last_unstale":"2024-02-26T12:19:20.469337+0000","last_undegraded":"2024-02-26T12:19:20.469337+0000","last_fullsized":"2024-02-26T12:19:20.469337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452990+0000","last_change":"2024-02-26T12:19:19.458902+0000","last_active":"2024-02-26T12:19:20.452990+0000","last_peered":"2024-02-26T12:19:20.452990+0000","last_clean":"2024-02-26T12:19:20.452990+0000","last_became_active":"2024-02-26T12:19:19.458618+0000","last_became_peered":"2024-02-26T12:19:19.458618+0000","last_unstale":"2024-02-26T12:19:20.452990+0000","last_undegraded":"2024-02-26T12:19:20.452990+0000","last_fullsized":"2024-02-26T12:19:20.452990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932599+0000","last_change":"2024-02-26T12:19:18.461020+0000","last_active":"2024-02-26T12:19:20.932599+0000","last_peered":"2024-02-26T12:19:20.932599+0000","last_clean":"2024-02-26T12:19:20.932599+0000","last_became_active":"2024-02-26T12:19:18.460670+0000","last_became_peered":"2024-02-26T12:19:18.460670+0000","last_unstale":"2024-02-26T12:19:20.932599+0000","last_undegraded":"2024-02-26T12:19:20.932599+0000","last_fullsized":"2024-02-26T12:19:20.932599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452392+0000","last_change":"2024-02-26T12:19:19.458148+0000","last_active":"2024-02-26T12:19:20.452392+0000","last_peered":"2024-02-26T12:19:20.452392+0000","last_clean":"2024-02-26T12:19:20.452392+0000","last_became_active":"2024-02-26T12:19:19.457530+0000","last_became_peered":"2024-02-26T12:19:19.457530+0000","last_unstale":"2024-02-26T12:19:20.452392+0000","last_undegraded":"2024-02-26T12:19:20.452392+0000","last_fullsized":"2024-02-26T12:19:20.452392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932807+0000","last_change":"2024-02-26T12:19:18.465248+0000","last_active":"2024-02-26T12:19:20.932807+0000","last_peered":"2024-02-26T12:19:20.932807+0000","last_clean":"2024-02-26T12:19:20.932807+0000","last_became_active":"2024-02-26T12:19:18.464973+0000","last_became_peered":"2024-02-26T12:19:18.464973+0000","last_unstale":"2024-02-26T12:19:20.932807+0000","last_undegraded":"2024-02-26T12:19:20.932807+0000","last_fullsized":"2024-02-26T12:19:20.932807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933345+0000","last_change":"2024-02-26T12:19:19.463869+0000","last_active":"2024-02-26T12:19:20.933345+0000","last_peered":"2024-02-26T12:19:20.933345+0000","last_clean":"2024-02-26T12:19:20.933345+0000","last_became_active":"2024-02-26T12:19:19.463540+0000","last_became_peered":"2024-02-26T12:19:19.463540+0000","last_unstale":"2024-02-26T12:19:20.933345+0000","last_undegraded":"2024-02-26T12:19:20.933345+0000","last_fullsized":"2024-02-26T12:19:20.933345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932626+0000","last_change":"2024-02-26T12:19:18.459968+0000","last_active":"2024-02-26T12:19:20.932626+0000","last_peered":"2024-02-26T12:19:20.932626+0000","last_clean":"2024-02-26T12:19:20.932626+0000","last_became_active":"2024-02-26T12:19:18.459646+0000","last_became_peered":"2024-02-26T12:19:18.459646+0000","last_unstale":"2024-02-26T12:19:20.932626+0000","last_undegraded":"2024-02-26T12:19:20.932626+0000","last_fullsized":"2024-02-26T12:19:20.932626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932466+0000","last_change":"2024-02-26T12:19:19.468378+0000","last_active":"2024-02-26T12:19:20.932466+0000","last_peered":"2024-02-26T12:19:20.932466+0000","last_clean":"2024-02-26T12:19:20.932466+0000","last_became_active":"2024-02-26T12:19:19.467864+0000","last_became_peered":"2024-02-26T12:19:19.467864+0000","last_unstale":"2024-02-26T12:19:20.932466+0000","last_undegraded":"2024-02-26T12:19:20.932466+0000","last_fullsized":"2024-02-26T12:19:20.932466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933450+0000","last_change":"2024-02-26T12:19:18.463225+0000","last_active":"2024-02-26T12:19:20.933450+0000","last_peered":"2024-02-26T12:19:20.933450+0000","last_clean":"2024-02-26T12:19:20.933450+0000","last_became_active":"2024-02-26T12:19:18.462195+0000","last_became_peered":"2024-02-26T12:19:18.462195+0000","last_unstale":"2024-02-26T12:19:20.933450+0000","last_undegraded":"2024-02-26T12:19:20.933450+0000","last_fullsized":"2024-02-26T12:19:20.933450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:08:24.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:19:26.028 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:19:26.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.181+0000 7f61a042d640 1 Processor -- start 2024-02-26T12:19:26.167 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.181+0000 7f61a042d640 1 -- start start 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.182+0000 7f61a042d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61980cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.182+0000 7f61a042d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f61980b3300 0x7f61980b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.182+0000 7f61a042d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980cc010 con 0x7f61981621b0 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.182+0000 7f61a042d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619806c370 con 0x7f61980b3300 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.182+0000 7f61a042d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980ccba0 con 0x7f619815dc20 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f61981621b0 0x7f619806bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58022/0 (socket says 172.21.15.113:58022) 2024-02-26T12:19:26.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 -- 172.21.15.113:0/894653409 learned_addr learned my addr 172.21.15.113:0/894653409 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619e9ca640 1 --2- 172.21.15.113:0/894653409 >> v2:172.21.15.152:3300/0 conn(0x7f61980b3300 0x7f61980b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619e1c9640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61980cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912464170 0 0) 0x7f6188001110 con 0x7f61981621b0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6184003520 con 0x7f61981621b0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231835459 0 0) 0x7f6184003520 con 0x7f61981621b0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 msgr2=0x7f61980cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61980cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 >> v2:172.21.15.152:3300/0 conn(0x7f61980b3300 msgr2=0x7f61980b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 --2- 172.21.15.113:0/894653409 >> v2:172.21.15.152:3300/0 conn(0x7f61980b3300 0x7f61980b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980cc290 con 0x7f61981621b0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f6188001840 con 0x7f61981621b0 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 >> v1:172.21.15.113:6789/0 conn(0x7f61981621b0 legacy=0x7f619806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840039b0 0x7f6184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619806c370 con 0x7f6184004800 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980ccba0 con 0x7f61840039b0 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618400b9c0 con 0x7f619815dc20 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619e1c9640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840039b0 0x7f6184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619e9ca640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 -- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 msgr2=0x7f61840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f619815dc20 0x7f61840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 -- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840039b0 msgr2=0x7f6184003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61840039b0 0x7f6184003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.183+0000 7f619d9c8640 1 -- 172.21.15.113:0/894653409 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184003520 con 0x7f6184004800 2024-02-26T12:19:26.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.184+0000 7f619d9c8640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6184004c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f618800c490 tx=0x7f6184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b637a0332311b33 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.184+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800c0e0 con 0x7f6184004800 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.184+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188030070 con 0x7f6184004800 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.184+0000 7f619d1c7640 1 -- 172.21.15.113:0/894653409 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880058d0 con 0x7f6184004800 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 -- 172.21.15.113:0/894653409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 msgr2=0x7f6184004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 --2- 172.21.15.113:0/894653409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6184004c80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f618800c490 tx=0x7f6184005830 comp rx=0 tx=0).stop 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f619e9ca640 1 -- 172.21.15.113:0/894653409 reap_dead start 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 -- 172.21.15.113:0/894653409 shutdown_connections 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 -- 172.21.15.113:0/894653409 >> 172.21.15.113:0/894653409 conn(0x7f61980ce300 msgr2=0x7f61980ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 -- 172.21.15.113:0/894653409 shutdown_connections 2024-02-26T12:19:26.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.185+0000 7f61a042d640 1 -- 172.21.15.113:0/894653409 wait complete. 2024-02-26T12:19:26.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.186+0000 7f61a042d640 1 Processor -- start 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.186+0000 7f61a042d640 1 -- start start 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6198160e70 0x7f61980b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61980b7130 0x7f619814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980cc830 con 0x7f6184004800 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980d0510 con 0x7f61980b7130 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f61a042d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619815e000 con 0x7f6198160e70 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38496/0 (socket says 172.21.15.113:38496) 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 -- 172.21.15.113:0/3200767139 learned_addr learned my addr 172.21.15.113:0/3200767139 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619d9c8640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6198160e70 0x7f61980b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e9ca640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61980b7130 0x7f619814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 -- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6198160e70 msgr2=0x7f61980b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6198160e70 0x7f61980b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 -- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61980b7130 msgr2=0x7f619814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61980b7130 0x7f619814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 -- 172.21.15.113:0/3200767139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6198160130 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f619e1c9640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6194009fc0 tx=0x7f619400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400fea0 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.187+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6194015630 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.188+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194015a20 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.188+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619815f090 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.188+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619815f650 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.189+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61980b7800 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.189+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6194015bc0 con 0x7f6184004800 2024-02-26T12:19:26.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.189+0000 7f618effd640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 0x7f617c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.189+0000 7f619d9c8640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 0x7f617c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.189+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f619408b380 con 0x7f6184004800 2024-02-26T12:19:26.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.190+0000 7f619d9c8640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 0x7f617c06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6188001050 tx=0x7f6188007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.194+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6194019030 con 0x7f6184004800 2024-02-26T12:19:26.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.359+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f619815b5e0 con 0x7f617c06b4d0 2024-02-26T12:19:26.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.365+0000 7f618effd640 1 -- 172.21.15.113:0/3200767139 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251835 (secure 0 0 0) 0x7f619815b5e0 con 0x7f617c06b4d0 2024-02-26T12:19:26.353 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:26.354 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:19:26.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 msgr2=0x7f617c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 0x7f617c06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6188001050 tx=0x7f6188007000 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 msgr2=0x7f6198160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6194009fc0 tx=0x7f619400f580 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 shutdown_connections 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f617c06b4d0 0x7f617c06d990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61980b7130 0x7f619814b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6198160e70 0x7f61980b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 --2- 172.21.15.113:0/3200767139 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6184004800 0x7f6198160930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 >> 172.21.15.113:0/3200767139 conn(0x7f61980ce300 msgr2=0x7f619806cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 shutdown_connections 2024-02-26T12:19:26.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.368+0000 7f61a042d640 1 -- 172.21.15.113:0/3200767139 wait complete. 2024-02-26T12:19:26.364 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-02-26T12:19:25.156761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219020,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755700,"statfs":{"total":773094113280,"available":772869836800,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.712245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933043+0000","last_change":"2024-02-26T12:19:19.469679+0000","last_active":"2024-02-26T12:19:20.933043+0000","last_peered":"2024-02-26T12:19:20.933043+0000","last_clean":"2024-02-26T12:19:20.933043+0000","last_became_active":"2024-02-26T12:19:19.469330+0000","last_became_peered":"2024-02-26T12:19:19.469330+0000","last_unstale":"2024-02-26T12:19:20.933043+0000","last_undegraded":"2024-02-26T12:19:20.933043+0000","last_fullsized":"2024-02-26T12:19:20.933043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449495+0000","last_change":"2024-02-26T12:19:19.464902+0000","last_active":"2024-02-26T12:19:20.449495+0000","last_peered":"2024-02-26T12:19:20.449495+0000","last_clean":"2024-02-26T12:19:20.449495+0000","last_became_active":"2024-02-26T12:19:19.464146+0000","last_became_peered":"2024-02-26T12:19:19.464146+0000","last_unstale":"2024-02-26T12:19:20.449495+0000","last_undegraded":"2024-02-26T12:19:20.449495+0000","last_fullsized":"2024-02-26T12:19:20.449495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933290+0000","last_change":"2024-02-26T12:19:19.455501+0000","last_active":"2024-02-26T12:19:20.933290+0000","last_peered":"2024-02-26T12:19:20.933290+0000","last_clean":"2024-02-26T12:19:20.933290+0000","last_became_active":"2024-02-26T12:19:19.455220+0000","last_became_peered":"2024-02-26T12:19:19.455220+0000","last_unstale":"2024-02-26T12:19:20.933290+0000","last_undegraded":"2024-02-26T12:19:20.933290+0000","last_fullsized":"2024-02-26T12:19:20.933290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:18.000356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452612+0000","last_change":"2024-02-26T12:19:19.463628+0000","last_active":"2024-02-26T12:19:20.452612+0000","last_peered":"2024-02-26T12:19:20.452612+0000","last_clean":"2024-02-26T12:19:20.452612+0000","last_became_active":"2024-02-26T12:19:19.463142+0000","last_became_peered":"2024-02-26T12:19:19.463142+0000","last_unstale":"2024-02-26T12:19:20.452612+0000","last_undegraded":"2024-02-26T12:19:20.452612+0000","last_fullsized":"2024-02-26T12:19:20.452612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932648+0000","last_change":"2024-02-26T12:19:19.474833+0000","last_active":"2024-02-26T12:19:20.932648+0000","last_peered":"2024-02-26T12:19:20.932648+0000","last_clean":"2024-02-26T12:19:20.932648+0000","last_became_active":"2024-02-26T12:19:19.474460+0000","last_became_peered":"2024-02-26T12:19:19.474460+0000","last_unstale":"2024-02-26T12:19:20.932648+0000","last_undegraded":"2024-02-26T12:19:20.932648+0000","last_fullsized":"2024-02-26T12:19:20.932648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:10.059133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452346+0000","last_change":"2024-02-26T12:19:19.465004+0000","last_active":"2024-02-26T12:19:20.452346+0000","last_peered":"2024-02-26T12:19:20.452346+0000","last_clean":"2024-02-26T12:19:20.452346+0000","last_became_active":"2024-02-26T12:19:19.464746+0000","last_became_peered":"2024-02-26T12:19:19.464746+0000","last_unstale":"2024-02-26T12:19:20.452346+0000","last_undegraded":"2024-02-26T12:19:20.452346+0000","last_fullsized":"2024-02-26T12:19:20.452346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932594+0000","last_change":"2024-02-26T12:19:19.472236+0000","last_active":"2024-02-26T12:19:20.932594+0000","last_peered":"2024-02-26T12:19:20.932594+0000","last_clean":"2024-02-26T12:19:20.932594+0000","last_became_active":"2024-02-26T12:19:19.471857+0000","last_became_peered":"2024-02-26T12:19:19.471857+0000","last_unstale":"2024-02-26T12:19:20.932594+0000","last_undegraded":"2024-02-26T12:19:20.932594+0000","last_fullsized":"2024-02-26T12:19:20.932594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932555+0000","last_change":"2024-02-26T12:19:19.471776+0000","last_active":"2024-02-26T12:19:20.932555+0000","last_peered":"2024-02-26T12:19:20.932555+0000","last_clean":"2024-02-26T12:19:20.932555+0000","last_became_active":"2024-02-26T12:19:19.471502+0000","last_became_peered":"2024-02-26T12:19:19.471502+0000","last_unstale":"2024-02-26T12:19:20.932555+0000","last_undegraded":"2024-02-26T12:19:20.932555+0000","last_fullsized":"2024-02-26T12:19:20.932555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933050+0000","last_change":"2024-02-26T12:19:19.477637+0000","last_active":"2024-02-26T12:19:20.933050+0000","last_peered":"2024-02-26T12:19:20.933050+0000","last_clean":"2024-02-26T12:19:20.933050+0000","last_became_active":"2024-02-26T12:19:19.476957+0000","last_became_peered":"2024-02-26T12:19:19.476957+0000","last_unstale":"2024-02-26T12:19:20.933050+0000","last_undegraded":"2024-02-26T12:19:20.933050+0000","last_fullsized":"2024-02-26T12:19:20.933050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:09:58.291307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469618+0000","last_change":"2024-02-26T12:19:19.463237+0000","last_active":"2024-02-26T12:19:20.469618+0000","last_peered":"2024-02-26T12:19:20.469618+0000","last_clean":"2024-02-26T12:19:20.469618+0000","last_became_active":"2024-02-26T12:19:19.462923+0000","last_became_peered":"2024-02-26T12:19:19.462923+0000","last_unstale":"2024-02-26T12:19:20.469618+0000","last_undegraded":"2024-02-26T12:19:20.469618+0000","last_fullsized":"2024-02-26T12:19:20.469618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469534+0000","last_change":"2024-02-26T12:19:19.469387+0000","last_active":"2024-02-26T12:19:20.469534+0000","last_peered":"2024-02-26T12:19:20.469534+0000","last_clean":"2024-02-26T12:19:20.469534+0000","last_became_active":"2024-02-26T12:19:19.469106+0000","last_became_peered":"2024-02-26T12:19:19.469106+0000","last_unstale":"2024-02-26T12:19:20.469534+0000","last_undegraded":"2024-02-26T12:19:20.469534+0000","last_fullsized":"2024-02-26T12:19:20.469534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453265+0000","last_change":"2024-02-26T12:19:19.462424+0000","last_active":"2024-02-26T12:19:20.453265+0000","last_peered":"2024-02-26T12:19:20.453265+0000","last_clean":"2024-02-26T12:19:20.453265+0000","last_became_active":"2024-02-26T12:19:19.462155+0000","last_became_peered":"2024-02-26T12:19:19.462155+0000","last_unstale":"2024-02-26T12:19:20.453265+0000","last_undegraded":"2024-02-26T12:19:20.453265+0000","last_fullsized":"2024-02-26T12:19:20.453265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932944+0000","last_change":"2024-02-26T12:19:19.468734+0000","last_active":"2024-02-26T12:19:20.932944+0000","last_peered":"2024-02-26T12:19:20.932944+0000","last_clean":"2024-02-26T12:19:20.932944+0000","last_became_active":"2024-02-26T12:19:19.468362+0000","last_became_peered":"2024-02-26T12:19:19.468362+0000","last_unstale":"2024-02-26T12:19:20.932944+0000","last_undegraded":"2024-02-26T12:19:20.932944+0000","last_fullsized":"2024-02-26T12:19:20.932944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933218+0000","last_change":"2024-02-26T12:19:19.458457+0000","last_active":"2024-02-26T12:19:20.933218+0000","last_peered":"2024-02-26T12:19:20.933218+0000","last_clean":"2024-02-26T12:19:20.933218+0000","last_became_active":"2024-02-26T12:19:19.458167+0000","last_became_peered":"2024-02-26T12:19:19.458167+0000","last_unstale":"2024-02-26T12:19:20.933218+0000","last_undegraded":"2024-02-26T12:19:20.933218+0000","last_fullsized":"2024-02-26T12:19:20.933218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:34:16.814402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449347+0000","last_change":"2024-02-26T12:19:19.457554+0000","last_active":"2024-02-26T12:19:20.449347+0000","last_peered":"2024-02-26T12:19:20.449347+0000","last_clean":"2024-02-26T12:19:20.449347+0000","last_became_active":"2024-02-26T12:19:19.457255+0000","last_became_peered":"2024-02-26T12:19:19.457255+0000","last_unstale":"2024-02-26T12:19:20.449347+0000","last_undegraded":"2024-02-26T12:19:20.449347+0000","last_fullsized":"2024-02-26T12:19:20.449347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452064+0000","last_change":"2024-02-26T12:19:19.454291+0000","last_active":"2024-02-26T12:19:20.452064+0000","last_peered":"2024-02-26T12:19:20.452064+0000","last_clean":"2024-02-26T12:19:20.452064+0000","last_became_active":"2024-02-26T12:19:19.454008+0000","last_became_peered":"2024-02-26T12:19:19.454008+0000","last_unstale":"2024-02-26T12:19:20.452064+0000","last_undegraded":"2024-02-26T12:19:20.452064+0000","last_fullsized":"2024-02-26T12:19:20.452064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453519+0000","last_change":"2024-02-26T12:19:19.470053+0000","last_active":"2024-02-26T12:19:20.453519+0000","last_peered":"2024-02-26T12:19:20.453519+0000","last_clean":"2024-02-26T12:19:20.453519+0000","last_became_active":"2024-02-26T12:19:19.469775+0000","last_became_peered":"2024-02-26T12:19:19.469775+0000","last_unstale":"2024-02-26T12:19:20.453519+0000","last_undegraded":"2024-02-26T12:19:20.453519+0000","last_fullsized":"2024-02-26T12:19:20.453519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:07:27.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932459+0000","last_change":"2024-02-26T12:19:19.467381+0000","last_active":"2024-02-26T12:19:20.932459+0000","last_peered":"2024-02-26T12:19:20.932459+0000","last_clean":"2024-02-26T12:19:20.932459+0000","last_became_active":"2024-02-26T12:19:19.467003+0000","last_became_peered":"2024-02-26T12:19:19.467003+0000","last_unstale":"2024-02-26T12:19:20.932459+0000","last_undegraded":"2024-02-26T12:19:20.932459+0000","last_fullsized":"2024-02-26T12:19:20.932459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:25.687909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932943+0000","last_change":"2024-02-26T12:19:19.472512+0000","last_active":"2024-02-26T12:19:20.932943+0000","last_peered":"2024-02-26T12:19:20.932943+0000","last_clean":"2024-02-26T12:19:20.932943+0000","last_became_active":"2024-02-26T12:19:19.472179+0000","last_became_peered":"2024-02-26T12:19:19.472179+0000","last_unstale":"2024-02-26T12:19:20.932943+0000","last_undegraded":"2024-02-26T12:19:20.932943+0000","last_fullsized":"2024-02-26T12:19:20.932943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469423+0000","last_change":"2024-02-26T12:19:19.458929+0000","last_active":"2024-02-26T12:19:20.469423+0000","last_peered":"2024-02-26T12:19:20.469423+0000","last_clean":"2024-02-26T12:19:20.469423+0000","last_became_active":"2024-02-26T12:19:19.458670+0000","last_became_peered":"2024-02-26T12:19:19.458670+0000","last_unstale":"2024-02-26T12:19:20.469423+0000","last_undegraded":"2024-02-26T12:19:20.469423+0000","last_fullsized":"2024-02-26T12:19:20.469423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933262+0000","last_change":"2024-02-26T12:19:19.474768+0000","last_active":"2024-02-26T12:19:20.933262+0000","last_peered":"2024-02-26T12:19:20.933262+0000","last_clean":"2024-02-26T12:19:20.933262+0000","last_became_active":"2024-02-26T12:19:19.474509+0000","last_became_peered":"2024-02-26T12:19:19.474509+0000","last_unstale":"2024-02-26T12:19:20.933262+0000","last_undegraded":"2024-02-26T12:19:20.933262+0000","last_fullsized":"2024-02-26T12:19:20.933262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:18:43.353358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452428+0000","last_change":"2024-02-26T12:19:19.469403+0000","last_active":"2024-02-26T12:19:20.452428+0000","last_peered":"2024-02-26T12:19:20.452428+0000","last_clean":"2024-02-26T12:19:20.452428+0000","last_became_active":"2024-02-26T12:19:19.469137+0000","last_became_peered":"2024-02-26T12:19:19.469137+0000","last_unstale":"2024-02-26T12:19:20.452428+0000","last_undegraded":"2024-02-26T12:19:20.452428+0000","last_fullsized":"2024-02-26T12:19:20.452428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932447+0000","last_change":"2024-02-26T12:19:19.459664+0000","last_active":"2024-02-26T12:19:20.932447+0000","last_peered":"2024-02-26T12:19:20.932447+0000","last_clean":"2024-02-26T12:19:20.932447+0000","last_became_active":"2024-02-26T12:19:19.459409+0000","last_became_peered":"2024-02-26T12:19:19.459409+0000","last_unstale":"2024-02-26T12:19:20.932447+0000","last_undegraded":"2024-02-26T12:19:20.932447+0000","last_fullsized":"2024-02-26T12:19:20.932447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452126+0000","last_change":"2024-02-26T12:19:19.465721+0000","last_active":"2024-02-26T12:19:20.452126+0000","last_peered":"2024-02-26T12:19:20.452126+0000","last_clean":"2024-02-26T12:19:20.452126+0000","last_became_active":"2024-02-26T12:19:19.465390+0000","last_became_peered":"2024-02-26T12:19:19.465390+0000","last_unstale":"2024-02-26T12:19:20.452126+0000","last_undegraded":"2024-02-26T12:19:20.452126+0000","last_fullsized":"2024-02-26T12:19:20.452126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932702+0000","last_change":"2024-02-26T12:19:19.461546+0000","last_active":"2024-02-26T12:19:20.932702+0000","last_peered":"2024-02-26T12:19:20.932702+0000","last_clean":"2024-02-26T12:19:20.932702+0000","last_became_active":"2024-02-26T12:19:19.461235+0000","last_became_peered":"2024-02-26T12:19:19.461235+0000","last_unstale":"2024-02-26T12:19:20.932702+0000","last_undegraded":"2024-02-26T12:19:20.932702+0000","last_fullsized":"2024-02-26T12:19:20.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469664+0000","last_change":"2024-02-26T12:19:19.470118+0000","last_active":"2024-02-26T12:19:20.469664+0000","last_peered":"2024-02-26T12:19:20.469664+0000","last_clean":"2024-02-26T12:19:20.469664+0000","last_became_active":"2024-02-26T12:19:19.469859+0000","last_became_peered":"2024-02-26T12:19:19.469859+0000","last_unstale":"2024-02-26T12:19:20.469664+0000","last_undegraded":"2024-02-26T12:19:20.469664+0000","last_fullsized":"2024-02-26T12:19:20.469664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449593+0000","last_change":"2024-02-26T12:19:19.461901+0000","last_active":"2024-02-26T12:19:20.449593+0000","last_peered":"2024-02-26T12:19:20.449593+0000","last_clean":"2024-02-26T12:19:20.449593+0000","last_became_active":"2024-02-26T12:19:19.461611+0000","last_became_peered":"2024-02-26T12:19:19.461611+0000","last_unstale":"2024-02-26T12:19:20.449593+0000","last_undegraded":"2024-02-26T12:19:20.449593+0000","last_fullsized":"2024-02-26T12:19:20.449593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.466246+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.465853+0000","last_became_peered":"2024-02-26T12:19:19.465853+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933418+0000","last_change":"2024-02-26T12:19:19.462596+0000","last_active":"2024-02-26T12:19:20.933418+0000","last_peered":"2024-02-26T12:19:20.933418+0000","last_clean":"2024-02-26T12:19:20.933418+0000","last_became_active":"2024-02-26T12:19:19.462151+0000","last_became_peered":"2024-02-26T12:19:19.462151+0000","last_unstale":"2024-02-26T12:19:20.933418+0000","last_undegraded":"2024-02-26T12:19:20.933418+0000","last_fullsized":"2024-02-26T12:19:20.933418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452517+0000","last_change":"2024-02-26T12:19:19.463840+0000","last_active":"2024-02-26T12:19:20.452517+0000","last_peered":"2024-02-26T12:19:20.452517+0000","last_clean":"2024-02-26T12:19:20.452517+0000","last_became_active":"2024-02-26T12:19:19.462936+0000","last_became_peered":"2024-02-26T12:19:19.462936+0000","last_unstale":"2024-02-26T12:19:20.452517+0000","last_undegraded":"2024-02-26T12:19:20.452517+0000","last_fullsized":"2024-02-26T12:19:20.452517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932299+0000","last_change":"2024-02-26T12:19:19.463407+0000","last_active":"2024-02-26T12:19:20.932299+0000","last_peered":"2024-02-26T12:19:20.932299+0000","last_clean":"2024-02-26T12:19:20.932299+0000","last_became_active":"2024-02-26T12:19:19.463126+0000","last_became_peered":"2024-02-26T12:19:19.463126+0000","last_unstale":"2024-02-26T12:19:20.932299+0000","last_undegraded":"2024-02-26T12:19:20.932299+0000","last_fullsized":"2024-02-26T12:19:20.932299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469300+0000","last_change":"2024-02-26T12:19:19.466527+0000","last_active":"2024-02-26T12:19:20.469300+0000","last_peered":"2024-02-26T12:19:20.469300+0000","last_clean":"2024-02-26T12:19:20.469300+0000","last_became_active":"2024-02-26T12:19:19.466230+0000","last_became_peered":"2024-02-26T12:19:19.466230+0000","last_unstale":"2024-02-26T12:19:20.469300+0000","last_undegraded":"2024-02-26T12:19:20.469300+0000","last_fullsized":"2024-02-26T12:19:20.469300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453228+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.453228+0000","last_peered":"2024-02-26T12:19:20.453228+0000","last_clean":"2024-02-26T12:19:20.453228+0000","last_became_active":"2024-02-26T12:19:19.458585+0000","last_became_peered":"2024-02-26T12:19:19.458585+0000","last_unstale":"2024-02-26T12:19:20.453228+0000","last_undegraded":"2024-02-26T12:19:20.453228+0000","last_fullsized":"2024-02-26T12:19:20.453228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:18.627582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932859+0000","last_change":"2024-02-26T12:19:18.462238+0000","last_active":"2024-02-26T12:19:20.932859+0000","last_peered":"2024-02-26T12:19:20.932859+0000","last_clean":"2024-02-26T12:19:20.932859+0000","last_became_active":"2024-02-26T12:19:18.461454+0000","last_became_peered":"2024-02-26T12:19:18.461454+0000","last_unstale":"2024-02-26T12:19:20.932859+0000","last_undegraded":"2024-02-26T12:19:20.932859+0000","last_fullsized":"2024-02-26T12:19:20.932859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933404+0000","last_change":"2024-02-26T12:19:19.454565+0000","last_active":"2024-02-26T12:19:20.933404+0000","last_peered":"2024-02-26T12:19:20.933404+0000","last_clean":"2024-02-26T12:19:20.933404+0000","last_became_active":"2024-02-26T12:19:19.454147+0000","last_became_peered":"2024-02-26T12:19:19.454147+0000","last_unstale":"2024-02-26T12:19:20.933404+0000","last_undegraded":"2024-02-26T12:19:20.933404+0000","last_fullsized":"2024-02-26T12:19:20.933404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469231+0000","last_change":"2024-02-26T12:19:18.462539+0000","last_active":"2024-02-26T12:19:20.469231+0000","last_peered":"2024-02-26T12:19:20.469231+0000","last_clean":"2024-02-26T12:19:20.469231+0000","last_became_active":"2024-02-26T12:19:18.462256+0000","last_became_peered":"2024-02-26T12:19:18.462256+0000","last_unstale":"2024-02-26T12:19:20.469231+0000","last_undegraded":"2024-02-26T12:19:20.469231+0000","last_fullsized":"2024-02-26T12:19:20.469231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932590+0000","last_change":"2024-02-26T12:19:18.463188+0000","last_active":"2024-02-26T12:19:20.932590+0000","last_peered":"2024-02-26T12:19:20.932590+0000","last_clean":"2024-02-26T12:19:20.932590+0000","last_became_active":"2024-02-26T12:19:18.462775+0000","last_became_peered":"2024-02-26T12:19:18.462775+0000","last_unstale":"2024-02-26T12:19:20.932590+0000","last_undegraded":"2024-02-26T12:19:20.932590+0000","last_fullsized":"2024-02-26T12:19:20.932590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932747+0000","last_change":"2024-02-26T12:19:19.462308+0000","last_active":"2024-02-26T12:19:20.932747+0000","last_peered":"2024-02-26T12:19:20.932747+0000","last_clean":"2024-02-26T12:19:20.932747+0000","last_became_active":"2024-02-26T12:19:19.462011+0000","last_became_peered":"2024-02-26T12:19:19.462011+0000","last_unstale":"2024-02-26T12:19:20.932747+0000","last_undegraded":"2024-02-26T12:19:20.932747+0000","last_fullsized":"2024-02-26T12:19:20.932747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452209+0000","last_change":"2024-02-26T12:19:18.456487+0000","last_active":"2024-02-26T12:19:20.452209+0000","last_peered":"2024-02-26T12:19:20.452209+0000","last_clean":"2024-02-26T12:19:20.452209+0000","last_became_active":"2024-02-26T12:19:18.456207+0000","last_became_peered":"2024-02-26T12:19:18.456207+0000","last_unstale":"2024-02-26T12:19:20.452209+0000","last_undegraded":"2024-02-26T12:19:20.452209+0000","last_fullsized":"2024-02-26T12:19:20.452209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449517+0000","last_change":"2024-02-26T12:19:19.460550+0000","last_active":"2024-02-26T12:19:20.449517+0000","last_peered":"2024-02-26T12:19:20.449517+0000","last_clean":"2024-02-26T12:19:20.449517+0000","last_became_active":"2024-02-26T12:19:19.460265+0000","last_became_peered":"2024-02-26T12:19:19.460265+0000","last_unstale":"2024-02-26T12:19:20.449517+0000","last_undegraded":"2024-02-26T12:19:20.449517+0000","last_fullsized":"2024-02-26T12:19:20.449517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469567+0000","last_change":"2024-02-26T12:19:18.464033+0000","last_active":"2024-02-26T12:19:20.469567+0000","last_peered":"2024-02-26T12:19:20.469567+0000","last_clean":"2024-02-26T12:19:20.469567+0000","last_became_active":"2024-02-26T12:19:18.463599+0000","last_became_peered":"2024-02-26T12:19:18.463599+0000","last_unstale":"2024-02-26T12:19:20.469567+0000","last_undegraded":"2024-02-26T12:19:20.469567+0000","last_fullsized":"2024-02-26T12:19:20.469567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453466+0000","last_change":"2024-02-26T12:19:19.476744+0000","last_active":"2024-02-26T12:19:20.453466+0000","last_peered":"2024-02-26T12:19:20.453466+0000","last_clean":"2024-02-26T12:19:20.453466+0000","last_became_active":"2024-02-26T12:19:19.476456+0000","last_became_peered":"2024-02-26T12:19:19.476456+0000","last_unstale":"2024-02-26T12:19:20.453466+0000","last_undegraded":"2024-02-26T12:19:20.453466+0000","last_fullsized":"2024-02-26T12:19:20.453466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:33:50.358646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453526+0000","last_change":"2024-02-26T12:19:18.461181+0000","last_active":"2024-02-26T12:19:20.453526+0000","last_peered":"2024-02-26T12:19:20.453526+0000","last_clean":"2024-02-26T12:19:20.453526+0000","last_became_active":"2024-02-26T12:19:18.460919+0000","last_became_peered":"2024-02-26T12:19:18.460919+0000","last_unstale":"2024-02-26T12:19:20.453526+0000","last_undegraded":"2024-02-26T12:19:20.453526+0000","last_fullsized":"2024-02-26T12:19:20.453526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933451+0000","last_change":"2024-02-26T12:19:19.456644+0000","last_active":"2024-02-26T12:19:20.933451+0000","last_peered":"2024-02-26T12:19:20.933451+0000","last_clean":"2024-02-26T12:19:20.933451+0000","last_became_active":"2024-02-26T12:19:19.456368+0000","last_became_peered":"2024-02-26T12:19:19.456368+0000","last_unstale":"2024-02-26T12:19:20.933451+0000","last_undegraded":"2024-02-26T12:19:20.933451+0000","last_fullsized":"2024-02-26T12:19:20.933451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449625+0000","last_change":"2024-02-26T12:19:18.461795+0000","last_active":"2024-02-26T12:19:20.449625+0000","last_peered":"2024-02-26T12:19:20.449625+0000","last_clean":"2024-02-26T12:19:20.449625+0000","last_became_active":"2024-02-26T12:19:18.460734+0000","last_became_peered":"2024-02-26T12:19:18.460734+0000","last_unstale":"2024-02-26T12:19:20.449625+0000","last_undegraded":"2024-02-26T12:19:20.449625+0000","last_fullsized":"2024-02-26T12:19:20.449625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453339+0000","last_change":"2024-02-26T12:19:19.466977+0000","last_active":"2024-02-26T12:19:20.453339+0000","last_peered":"2024-02-26T12:19:20.453339+0000","last_clean":"2024-02-26T12:19:20.453339+0000","last_became_active":"2024-02-26T12:19:19.466691+0000","last_became_peered":"2024-02-26T12:19:19.466691+0000","last_unstale":"2024-02-26T12:19:20.453339+0000","last_undegraded":"2024-02-26T12:19:20.453339+0000","last_fullsized":"2024-02-26T12:19:20.453339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:36.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469361+0000","last_change":"2024-02-26T12:19:18.464762+0000","last_active":"2024-02-26T12:19:20.469361+0000","last_peered":"2024-02-26T12:19:20.469361+0000","last_clean":"2024-02-26T12:19:20.469361+0000","last_became_active":"2024-02-26T12:19:18.464498+0000","last_became_peered":"2024-02-26T12:19:18.464498+0000","last_unstale":"2024-02-26T12:19:20.469361+0000","last_undegraded":"2024-02-26T12:19:20.469361+0000","last_fullsized":"2024-02-26T12:19:20.469361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:06:09.472166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932633+0000","last_change":"2024-02-26T12:19:19.470554+0000","last_active":"2024-02-26T12:19:20.932633+0000","last_peered":"2024-02-26T12:19:20.932633+0000","last_clean":"2024-02-26T12:19:20.932633+0000","last_became_active":"2024-02-26T12:19:19.470255+0000","last_became_peered":"2024-02-26T12:19:19.470255+0000","last_unstale":"2024-02-26T12:19:20.932633+0000","last_undegraded":"2024-02-26T12:19:20.932633+0000","last_fullsized":"2024-02-26T12:19:20.932633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:22:16.863150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933472+0000","last_change":"2024-02-26T12:19:18.460695+0000","last_active":"2024-02-26T12:19:20.933472+0000","last_peered":"2024-02-26T12:19:20.933472+0000","last_clean":"2024-02-26T12:19:20.933472+0000","last_became_active":"2024-02-26T12:19:18.460421+0000","last_became_peered":"2024-02-26T12:19:18.460421+0000","last_unstale":"2024-02-26T12:19:20.933472+0000","last_undegraded":"2024-02-26T12:19:20.933472+0000","last_fullsized":"2024-02-26T12:19:20.933472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:43:36.801064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933177+0000","last_change":"2024-02-26T12:19:19.474064+0000","last_active":"2024-02-26T12:19:20.933177+0000","last_peered":"2024-02-26T12:19:20.933177+0000","last_clean":"2024-02-26T12:19:20.933177+0000","last_became_active":"2024-02-26T12:19:19.473790+0000","last_became_peered":"2024-02-26T12:19:19.473790+0000","last_unstale":"2024-02-26T12:19:20.933177+0000","last_undegraded":"2024-02-26T12:19:20.933177+0000","last_fullsized":"2024-02-26T12:19:20.933177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:25.284013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452545+0000","last_change":"2024-02-26T12:19:18.455061+0000","last_active":"2024-02-26T12:19:20.452545+0000","last_peered":"2024-02-26T12:19:20.452545+0000","last_clean":"2024-02-26T12:19:20.452545+0000","last_became_active":"2024-02-26T12:19:18.454770+0000","last_became_peered":"2024-02-26T12:19:18.454770+0000","last_unstale":"2024-02-26T12:19:20.452545+0000","last_undegraded":"2024-02-26T12:19:20.452545+0000","last_fullsized":"2024-02-26T12:19:20.452545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932700+0000","last_change":"2024-02-26T12:19:19.477159+0000","last_active":"2024-02-26T12:19:20.932700+0000","last_peered":"2024-02-26T12:19:20.932700+0000","last_clean":"2024-02-26T12:19:20.932700+0000","last_became_active":"2024-02-26T12:19:19.476899+0000","last_became_peered":"2024-02-26T12:19:19.476899+0000","last_unstale":"2024-02-26T12:19:20.932700+0000","last_undegraded":"2024-02-26T12:19:20.932700+0000","last_fullsized":"2024-02-26T12:19:20.932700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469219+0000","last_change":"2024-02-26T12:19:18.463068+0000","last_active":"2024-02-26T12:19:20.469219+0000","last_peered":"2024-02-26T12:19:20.469219+0000","last_clean":"2024-02-26T12:19:20.469219+0000","last_became_active":"2024-02-26T12:19:18.462586+0000","last_became_peered":"2024-02-26T12:19:18.462586+0000","last_unstale":"2024-02-26T12:19:20.469219+0000","last_undegraded":"2024-02-26T12:19:20.469219+0000","last_fullsized":"2024-02-26T12:19:20.469219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469287+0000","last_change":"2024-02-26T12:19:19.465821+0000","last_active":"2024-02-26T12:19:20.469287+0000","last_peered":"2024-02-26T12:19:20.469287+0000","last_clean":"2024-02-26T12:19:20.469287+0000","last_became_active":"2024-02-26T12:19:19.465294+0000","last_became_peered":"2024-02-26T12:19:19.465294+0000","last_unstale":"2024-02-26T12:19:20.469287+0000","last_undegraded":"2024-02-26T12:19:20.469287+0000","last_fullsized":"2024-02-26T12:19:20.469287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932061+0000","last_change":"2024-02-26T12:19:18.461135+0000","last_active":"2024-02-26T12:19:20.932061+0000","last_peered":"2024-02-26T12:19:20.932061+0000","last_clean":"2024-02-26T12:19:20.932061+0000","last_became_active":"2024-02-26T12:19:18.460849+0000","last_became_peered":"2024-02-26T12:19:18.460849+0000","last_unstale":"2024-02-26T12:19:20.932061+0000","last_undegraded":"2024-02-26T12:19:20.932061+0000","last_fullsized":"2024-02-26T12:19:20.932061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:55:52.430631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932547+0000","last_change":"2024-02-26T12:19:19.473888+0000","last_active":"2024-02-26T12:19:20.932547+0000","last_peered":"2024-02-26T12:19:20.932547+0000","last_clean":"2024-02-26T12:19:20.932547+0000","last_became_active":"2024-02-26T12:19:19.473207+0000","last_became_peered":"2024-02-26T12:19:19.473207+0000","last_unstale":"2024-02-26T12:19:20.932547+0000","last_undegraded":"2024-02-26T12:19:20.932547+0000","last_fullsized":"2024-02-26T12:19:20.932547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453157+0000","last_change":"2024-02-26T12:19:18.461104+0000","last_active":"2024-02-26T12:19:20.453157+0000","last_peered":"2024-02-26T12:19:20.453157+0000","last_clean":"2024-02-26T12:19:20.453157+0000","last_became_active":"2024-02-26T12:19:18.460836+0000","last_became_peered":"2024-02-26T12:19:18.460836+0000","last_unstale":"2024-02-26T12:19:20.453157+0000","last_undegraded":"2024-02-26T12:19:20.453157+0000","last_fullsized":"2024-02-26T12:19:20.453157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:47:30.665043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932927+0000","last_change":"2024-02-26T12:19:19.470461+0000","last_active":"2024-02-26T12:19:20.932927+0000","last_peered":"2024-02-26T12:19:20.932927+0000","last_clean":"2024-02-26T12:19:20.932927+0000","last_became_active":"2024-02-26T12:19:19.470152+0000","last_became_peered":"2024-02-26T12:19:19.470152+0000","last_unstale":"2024-02-26T12:19:20.932927+0000","last_undegraded":"2024-02-26T12:19:20.932927+0000","last_fullsized":"2024-02-26T12:19:20.932927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932510+0000","last_change":"2024-02-26T12:19:18.455812+0000","last_active":"2024-02-26T12:19:20.932510+0000","last_peered":"2024-02-26T12:19:20.932510+0000","last_clean":"2024-02-26T12:19:20.932510+0000","last_became_active":"2024-02-26T12:19:18.455182+0000","last_became_peered":"2024-02-26T12:19:18.455182+0000","last_unstale":"2024-02-26T12:19:20.932510+0000","last_undegraded":"2024-02-26T12:19:20.932510+0000","last_fullsized":"2024-02-26T12:19:20.932510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:11:34.382737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933136+0000","last_change":"2024-02-26T12:19:19.477606+0000","last_active":"2024-02-26T12:19:20.933136+0000","last_peered":"2024-02-26T12:19:20.933136+0000","last_clean":"2024-02-26T12:19:20.933136+0000","last_became_active":"2024-02-26T12:19:19.477293+0000","last_became_peered":"2024-02-26T12:19:19.477293+0000","last_unstale":"2024-02-26T12:19:20.933136+0000","last_undegraded":"2024-02-26T12:19:20.933136+0000","last_fullsized":"2024-02-26T12:19:20.933136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:07.309634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449697+0000","last_change":"2024-02-26T12:19:18.461425+0000","last_active":"2024-02-26T12:19:20.449697+0000","last_peered":"2024-02-26T12:19:20.449697+0000","last_clean":"2024-02-26T12:19:20.449697+0000","last_became_active":"2024-02-26T12:19:18.461141+0000","last_became_peered":"2024-02-26T12:19:18.461141+0000","last_unstale":"2024-02-26T12:19:20.449697+0000","last_undegraded":"2024-02-26T12:19:20.449697+0000","last_fullsized":"2024-02-26T12:19:20.449697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452805+0000","last_change":"2024-02-26T12:19:19.462834+0000","last_active":"2024-02-26T12:19:20.452805+0000","last_peered":"2024-02-26T12:19:20.452805+0000","last_clean":"2024-02-26T12:19:20.452805+0000","last_became_active":"2024-02-26T12:19:19.462465+0000","last_became_peered":"2024-02-26T12:19:19.462465+0000","last_unstale":"2024-02-26T12:19:20.452805+0000","last_undegraded":"2024-02-26T12:19:20.452805+0000","last_fullsized":"2024-02-26T12:19:20.452805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:06.380744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932370+0000","last_change":"2024-02-26T12:19:18.456646+0000","last_active":"2024-02-26T12:19:20.932370+0000","last_peered":"2024-02-26T12:19:20.932370+0000","last_clean":"2024-02-26T12:19:20.932370+0000","last_became_active":"2024-02-26T12:19:18.456316+0000","last_became_peered":"2024-02-26T12:19:18.456316+0000","last_unstale":"2024-02-26T12:19:20.932370+0000","last_undegraded":"2024-02-26T12:19:20.932370+0000","last_fullsized":"2024-02-26T12:19:20.932370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:15:21.737677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932817+0000","last_change":"2024-02-26T12:19:19.469817+0000","last_active":"2024-02-26T12:19:20.932817+0000","last_peered":"2024-02-26T12:19:20.932817+0000","last_clean":"2024-02-26T12:19:20.932817+0000","last_became_active":"2024-02-26T12:19:19.469355+0000","last_became_peered":"2024-02-26T12:19:19.469355+0000","last_unstale":"2024-02-26T12:19:20.932817+0000","last_undegraded":"2024-02-26T12:19:20.932817+0000","last_fullsized":"2024-02-26T12:19:20.932817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932422+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:19:20.932422+0000","last_peered":"2024-02-26T12:19:20.932422+0000","last_clean":"2024-02-26T12:19:20.932422+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:19:20.932422+0000","last_undegraded":"2024-02-26T12:19:20.932422+0000","last_fullsized":"2024-02-26T12:19:20.932422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452184+0000","last_change":"2024-02-26T12:19:18.456266+0000","last_active":"2024-02-26T12:19:20.452184+0000","last_peered":"2024-02-26T12:19:20.452184+0000","last_clean":"2024-02-26T12:19:20.452184+0000","last_became_active":"2024-02-26T12:19:18.455942+0000","last_became_peered":"2024-02-26T12:19:18.455942+0000","last_unstale":"2024-02-26T12:19:20.452184+0000","last_undegraded":"2024-02-26T12:19:20.452184+0000","last_fullsized":"2024-02-26T12:19:20.452184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933368+0000","last_change":"2024-02-26T12:19:19.470887+0000","last_active":"2024-02-26T12:19:20.933368+0000","last_peered":"2024-02-26T12:19:20.933368+0000","last_clean":"2024-02-26T12:19:20.933368+0000","last_became_active":"2024-02-26T12:19:19.470607+0000","last_became_peered":"2024-02-26T12:19:19.470607+0000","last_unstale":"2024-02-26T12:19:20.933368+0000","last_undegraded":"2024-02-26T12:19:20.933368+0000","last_fullsized":"2024-02-26T12:19:20.933368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:47.011390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932456+0000","last_change":"2024-02-26T12:19:18.465038+0000","last_active":"2024-02-26T12:19:20.932456+0000","last_peered":"2024-02-26T12:19:20.932456+0000","last_clean":"2024-02-26T12:19:20.932456+0000","last_became_active":"2024-02-26T12:19:18.464586+0000","last_became_peered":"2024-02-26T12:19:18.464586+0000","last_unstale":"2024-02-26T12:19:20.932456+0000","last_undegraded":"2024-02-26T12:19:20.932456+0000","last_fullsized":"2024-02-26T12:19:20.932456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932968+0000","last_change":"2024-02-26T12:19:19.453339+0000","last_active":"2024-02-26T12:19:20.932968+0000","last_peered":"2024-02-26T12:19:20.932968+0000","last_clean":"2024-02-26T12:19:20.932968+0000","last_became_active":"2024-02-26T12:19:19.453031+0000","last_became_peered":"2024-02-26T12:19:19.453031+0000","last_unstale":"2024-02-26T12:19:20.932968+0000","last_undegraded":"2024-02-26T12:19:20.932968+0000","last_fullsized":"2024-02-26T12:19:20.932968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932171+0000","last_change":"2024-02-26T12:19:18.455546+0000","last_active":"2024-02-26T12:19:20.932171+0000","last_peered":"2024-02-26T12:19:20.932171+0000","last_clean":"2024-02-26T12:19:20.932171+0000","last_became_active":"2024-02-26T12:19:18.455214+0000","last_became_peered":"2024-02-26T12:19:18.455214+0000","last_unstale":"2024-02-26T12:19:20.932171+0000","last_undegraded":"2024-02-26T12:19:20.932171+0000","last_fullsized":"2024-02-26T12:19:20.932171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:41:38.587403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449348+0000","last_change":"2024-02-26T12:19:19.458855+0000","last_active":"2024-02-26T12:19:20.449348+0000","last_peered":"2024-02-26T12:19:20.449348+0000","last_clean":"2024-02-26T12:19:20.449348+0000","last_became_active":"2024-02-26T12:19:19.458568+0000","last_became_peered":"2024-02-26T12:19:19.458568+0000","last_unstale":"2024-02-26T12:19:20.449348+0000","last_undegraded":"2024-02-26T12:19:20.449348+0000","last_fullsized":"2024-02-26T12:19:20.449348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:23.004684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452642+0000","last_change":"2024-02-26T12:19:18.462392+0000","last_active":"2024-02-26T12:19:20.452642+0000","last_peered":"2024-02-26T12:19:20.452642+0000","last_clean":"2024-02-26T12:19:20.452642+0000","last_became_active":"2024-02-26T12:19:18.462102+0000","last_became_peered":"2024-02-26T12:19:18.462102+0000","last_unstale":"2024-02-26T12:19:20.452642+0000","last_undegraded":"2024-02-26T12:19:20.452642+0000","last_fullsized":"2024-02-26T12:19:20.452642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453404+0000","last_change":"2024-02-26T12:19:19.457056+0000","last_active":"2024-02-26T12:19:20.453404+0000","last_peered":"2024-02-26T12:19:20.453404+0000","last_clean":"2024-02-26T12:19:20.453404+0000","last_became_active":"2024-02-26T12:19:19.456475+0000","last_became_peered":"2024-02-26T12:19:19.456475+0000","last_unstale":"2024-02-26T12:19:20.453404+0000","last_undegraded":"2024-02-26T12:19:20.453404+0000","last_fullsized":"2024-02-26T12:19:20.453404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:21.932897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449511+0000","last_change":"2024-02-26T12:19:18.460143+0000","last_active":"2024-02-26T12:19:20.449511+0000","last_peered":"2024-02-26T12:19:20.449511+0000","last_clean":"2024-02-26T12:19:20.449511+0000","last_became_active":"2024-02-26T12:19:18.459858+0000","last_became_peered":"2024-02-26T12:19:18.459858+0000","last_unstale":"2024-02-26T12:19:20.449511+0000","last_undegraded":"2024-02-26T12:19:20.449511+0000","last_fullsized":"2024-02-26T12:19:20.449511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:08:24.277179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453144+0000","last_change":"2024-02-26T12:19:19.462914+0000","last_active":"2024-02-26T12:19:20.453144+0000","last_peered":"2024-02-26T12:19:20.453144+0000","last_clean":"2024-02-26T12:19:20.453144+0000","last_became_active":"2024-02-26T12:19:19.462335+0000","last_became_peered":"2024-02-26T12:19:19.462335+0000","last_unstale":"2024-02-26T12:19:20.453144+0000","last_undegraded":"2024-02-26T12:19:20.453144+0000","last_fullsized":"2024-02-26T12:19:20.453144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:33:23.292426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932953+0000","last_change":"2024-02-26T12:19:18.464084+0000","last_active":"2024-02-26T12:19:20.932953+0000","last_peered":"2024-02-26T12:19:20.932953+0000","last_clean":"2024-02-26T12:19:20.932953+0000","last_became_active":"2024-02-26T12:19:18.463367+0000","last_became_peered":"2024-02-26T12:19:18.463367+0000","last_unstale":"2024-02-26T12:19:20.932953+0000","last_undegraded":"2024-02-26T12:19:20.932953+0000","last_fullsized":"2024-02-26T12:19:20.932953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449431+0000","last_change":"2024-02-26T12:19:19.461058+0000","last_active":"2024-02-26T12:19:20.449431+0000","last_peered":"2024-02-26T12:19:20.449431+0000","last_clean":"2024-02-26T12:19:20.449431+0000","last_became_active":"2024-02-26T12:19:19.460767+0000","last_became_peered":"2024-02-26T12:19:19.460767+0000","last_unstale":"2024-02-26T12:19:20.449431+0000","last_undegraded":"2024-02-26T12:19:20.449431+0000","last_fullsized":"2024-02-26T12:19:20.449431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:03:59.524620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.468823+0000","last_change":"2024-02-26T12:19:18.463879+0000","last_active":"2024-02-26T12:19:20.468823+0000","last_peered":"2024-02-26T12:19:20.468823+0000","last_clean":"2024-02-26T12:19:20.468823+0000","last_became_active":"2024-02-26T12:19:18.463588+0000","last_became_peered":"2024-02-26T12:19:18.463588+0000","last_unstale":"2024-02-26T12:19:20.468823+0000","last_undegraded":"2024-02-26T12:19:20.468823+0000","last_fullsized":"2024-02-26T12:19:20.468823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932829+0000","last_change":"2024-02-26T12:19:19.472563+0000","last_active":"2024-02-26T12:19:20.932829+0000","last_peered":"2024-02-26T12:19:20.932829+0000","last_clean":"2024-02-26T12:19:20.932829+0000","last_became_active":"2024-02-26T12:19:19.472300+0000","last_became_peered":"2024-02-26T12:19:19.472300+0000","last_unstale":"2024-02-26T12:19:20.932829+0000","last_undegraded":"2024-02-26T12:19:20.932829+0000","last_fullsized":"2024-02-26T12:19:20.932829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:37:52.272306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469619+0000","last_change":"2024-02-26T12:19:18.464144+0000","last_active":"2024-02-26T12:19:20.469619+0000","last_peered":"2024-02-26T12:19:20.469619+0000","last_clean":"2024-02-26T12:19:20.469619+0000","last_became_active":"2024-02-26T12:19:18.462912+0000","last_became_peered":"2024-02-26T12:19:18.462912+0000","last_unstale":"2024-02-26T12:19:20.469619+0000","last_undegraded":"2024-02-26T12:19:20.469619+0000","last_fullsized":"2024-02-26T12:19:20.469619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933409+0000","last_change":"2024-02-26T12:19:19.462865+0000","last_active":"2024-02-26T12:19:20.933409+0000","last_peered":"2024-02-26T12:19:20.933409+0000","last_clean":"2024-02-26T12:19:20.933409+0000","last_became_active":"2024-02-26T12:19:19.460986+0000","last_became_peered":"2024-02-26T12:19:19.460986+0000","last_unstale":"2024-02-26T12:19:20.933409+0000","last_undegraded":"2024-02-26T12:19:20.933409+0000","last_fullsized":"2024-02-26T12:19:20.933409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:01:02.640374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932323+0000","last_change":"2024-02-26T12:19:18.461638+0000","last_active":"2024-02-26T12:19:20.932323+0000","last_peered":"2024-02-26T12:19:20.932323+0000","last_clean":"2024-02-26T12:19:20.932323+0000","last_became_active":"2024-02-26T12:19:18.461352+0000","last_became_peered":"2024-02-26T12:19:18.461352+0000","last_unstale":"2024-02-26T12:19:20.932323+0000","last_undegraded":"2024-02-26T12:19:20.932323+0000","last_fullsized":"2024-02-26T12:19:20.932323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.453133+0000","last_change":"2024-02-26T12:19:19.455737+0000","last_active":"2024-02-26T12:19:20.453133+0000","last_peered":"2024-02-26T12:19:20.453133+0000","last_clean":"2024-02-26T12:19:20.453133+0000","last_became_active":"2024-02-26T12:19:19.454845+0000","last_became_peered":"2024-02-26T12:19:19.454845+0000","last_unstale":"2024-02-26T12:19:20.453133+0000","last_undegraded":"2024-02-26T12:19:20.453133+0000","last_fullsized":"2024-02-26T12:19:20.453133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:08.196993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449440+0000","last_change":"2024-02-26T12:19:18.462514+0000","last_active":"2024-02-26T12:19:20.449440+0000","last_peered":"2024-02-26T12:19:20.449440+0000","last_clean":"2024-02-26T12:19:20.449440+0000","last_became_active":"2024-02-26T12:19:18.461749+0000","last_became_peered":"2024-02-26T12:19:18.461749+0000","last_unstale":"2024-02-26T12:19:20.449440+0000","last_undegraded":"2024-02-26T12:19:20.449440+0000","last_fullsized":"2024-02-26T12:19:20.449440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:52:35.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932875+0000","last_change":"2024-02-26T12:19:19.461344+0000","last_active":"2024-02-26T12:19:20.932875+0000","last_peered":"2024-02-26T12:19:20.932875+0000","last_clean":"2024-02-26T12:19:20.932875+0000","last_became_active":"2024-02-26T12:19:19.461069+0000","last_became_peered":"2024-02-26T12:19:19.461069+0000","last_unstale":"2024-02-26T12:19:20.932875+0000","last_undegraded":"2024-02-26T12:19:20.932875+0000","last_fullsized":"2024-02-26T12:19:20.932875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:12:39.714563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.449411+0000","last_change":"2024-02-26T12:19:18.459629+0000","last_active":"2024-02-26T12:19:20.449411+0000","last_peered":"2024-02-26T12:19:20.449411+0000","last_clean":"2024-02-26T12:19:20.449411+0000","last_became_active":"2024-02-26T12:19:18.459350+0000","last_became_peered":"2024-02-26T12:19:18.459350+0000","last_unstale":"2024-02-26T12:19:20.449411+0000","last_undegraded":"2024-02-26T12:19:20.449411+0000","last_fullsized":"2024-02-26T12:19:20.449411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:20.926063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932758+0000","last_change":"2024-02-26T12:19:19.460693+0000","last_active":"2024-02-26T12:19:20.932758+0000","last_peered":"2024-02-26T12:19:20.932758+0000","last_clean":"2024-02-26T12:19:20.932758+0000","last_became_active":"2024-02-26T12:19:19.459680+0000","last_became_peered":"2024-02-26T12:19:19.459680+0000","last_unstale":"2024-02-26T12:19:20.932758+0000","last_undegraded":"2024-02-26T12:19:20.932758+0000","last_fullsized":"2024-02-26T12:19:20.932758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:44:01.349108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932791+0000","last_change":"2024-02-26T12:19:18.461202+0000","last_active":"2024-02-26T12:19:20.932791+0000","last_peered":"2024-02-26T12:19:20.932791+0000","last_clean":"2024-02-26T12:19:20.932791+0000","last_became_active":"2024-02-26T12:19:18.460874+0000","last_became_peered":"2024-02-26T12:19:18.460874+0000","last_unstale":"2024-02-26T12:19:20.932791+0000","last_undegraded":"2024-02-26T12:19:20.932791+0000","last_fullsized":"2024-02-26T12:19:20.932791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:34:16.993521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.469337+0000","last_change":"2024-02-26T12:19:19.465226+0000","last_active":"2024-02-26T12:19:20.469337+0000","last_peered":"2024-02-26T12:19:20.469337+0000","last_clean":"2024-02-26T12:19:20.469337+0000","last_became_active":"2024-02-26T12:19:19.464959+0000","last_became_peered":"2024-02-26T12:19:19.464959+0000","last_unstale":"2024-02-26T12:19:20.469337+0000","last_undegraded":"2024-02-26T12:19:20.469337+0000","last_fullsized":"2024-02-26T12:19:20.469337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:11:11.721954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452990+0000","last_change":"2024-02-26T12:19:19.458902+0000","last_active":"2024-02-26T12:19:20.452990+0000","last_peered":"2024-02-26T12:19:20.452990+0000","last_clean":"2024-02-26T12:19:20.452990+0000","last_became_active":"2024-02-26T12:19:19.458618+0000","last_became_peered":"2024-02-26T12:19:19.458618+0000","last_unstale":"2024-02-26T12:19:20.452990+0000","last_undegraded":"2024-02-26T12:19:20.452990+0000","last_fullsized":"2024-02-26T12:19:20.452990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:11:23.540796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932599+0000","last_change":"2024-02-26T12:19:18.461020+0000","last_active":"2024-02-26T12:19:20.932599+0000","last_peered":"2024-02-26T12:19:20.932599+0000","last_clean":"2024-02-26T12:19:20.932599+0000","last_became_active":"2024-02-26T12:19:18.460670+0000","last_became_peered":"2024-02-26T12:19:18.460670+0000","last_unstale":"2024-02-26T12:19:20.932599+0000","last_undegraded":"2024-02-26T12:19:20.932599+0000","last_fullsized":"2024-02-26T12:19:20.932599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:32:17.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.452392+0000","last_change":"2024-02-26T12:19:19.458148+0000","last_active":"2024-02-26T12:19:20.452392+0000","last_peered":"2024-02-26T12:19:20.452392+0000","last_clean":"2024-02-26T12:19:20.452392+0000","last_became_active":"2024-02-26T12:19:19.457530+0000","last_became_peered":"2024-02-26T12:19:19.457530+0000","last_unstale":"2024-02-26T12:19:20.452392+0000","last_undegraded":"2024-02-26T12:19:20.452392+0000","last_fullsized":"2024-02-26T12:19:20.452392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:47:37.913207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932807+0000","last_change":"2024-02-26T12:19:18.465248+0000","last_active":"2024-02-26T12:19:20.932807+0000","last_peered":"2024-02-26T12:19:20.932807+0000","last_clean":"2024-02-26T12:19:20.932807+0000","last_became_active":"2024-02-26T12:19:18.464973+0000","last_became_peered":"2024-02-26T12:19:18.464973+0000","last_unstale":"2024-02-26T12:19:20.932807+0000","last_undegraded":"2024-02-26T12:19:20.932807+0000","last_fullsized":"2024-02-26T12:19:20.932807+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:31:24.681074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933345+0000","last_change":"2024-02-26T12:19:19.463869+0000","last_active":"2024-02-26T12:19:20.933345+0000","last_peered":"2024-02-26T12:19:20.933345+0000","last_clean":"2024-02-26T12:19:20.933345+0000","last_became_active":"2024-02-26T12:19:19.463540+0000","last_became_peered":"2024-02-26T12:19:19.463540+0000","last_unstale":"2024-02-26T12:19:20.933345+0000","last_undegraded":"2024-02-26T12:19:20.933345+0000","last_fullsized":"2024-02-26T12:19:20.933345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:02:37.377044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932626+0000","last_change":"2024-02-26T12:19:18.459968+0000","last_active":"2024-02-26T12:19:20.932626+0000","last_peered":"2024-02-26T12:19:20.932626+0000","last_clean":"2024-02-26T12:19:20.932626+0000","last_became_active":"2024-02-26T12:19:18.459646+0000","last_became_peered":"2024-02-26T12:19:18.459646+0000","last_unstale":"2024-02-26T12:19:20.932626+0000","last_undegraded":"2024-02-26T12:19:20.932626+0000","last_fullsized":"2024-02-26T12:19:20.932626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:19:07.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.932466+0000","last_change":"2024-02-26T12:19:19.468378+0000","last_active":"2024-02-26T12:19:20.932466+0000","last_peered":"2024-02-26T12:19:20.932466+0000","last_clean":"2024-02-26T12:19:20.932466+0000","last_became_active":"2024-02-26T12:19:19.467864+0000","last_became_peered":"2024-02-26T12:19:19.467864+0000","last_unstale":"2024-02-26T12:19:20.932466+0000","last_undegraded":"2024-02-26T12:19:20.932466+0000","last_fullsized":"2024-02-26T12:19:20.932466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:18.438564+0000","last_clean_scrub_stamp":"2024-02-26T12:19:18.438564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:53:59.532115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-02-26T12:19:20.933450+0000","last_change":"2024-02-26T12:19:18.463225+0000","last_active":"2024-02-26T12:19:20.933450+0000","last_peered":"2024-02-26T12:19:20.933450+0000","last_clean":"2024-02-26T12:19:20.933450+0000","last_became_active":"2024-02-26T12:19:18.462195+0000","last_became_peered":"2024-02-26T12:19:18.462195+0000","last_unstale":"2024-02-26T12:19:20.933450+0000","last_undegraded":"2024-02-26T12:19:20.933450+0000","last_fullsized":"2024-02-26T12:19:20.933450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:17.431730+0000","last_clean_scrub_stamp":"2024-02-26T12:19:17.431730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:08:24.109376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:19:26.368 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-26T12:19:26.368 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-26T12:19:26.368 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-26T12:19:26.369 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-26T12:19:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.521+0000 7f1cf122d640 1 Processor -- start 2024-02-26T12:19:26.507 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.521+0000 7f1cf122d640 1 -- start start 2024-02-26T12:19:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cf122d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cf122d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cec0cd210 0x7f1cec0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cf122d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec0cdf90 con 0x7f1cec15abb0 2024-02-26T12:19:26.508 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cf122d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0cf6c0 con 0x7f1cec0cd210 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cf122d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cb690 con 0x7f1cec0ced20 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cec0cd210 0x7f1cec0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1cec0cd210 0x7f1cec0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38512/0 (socket says 172.21.15.113:38512) 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 -- 172.21.15.113:0/3975594559 learned_addr learned my addr 172.21.15.113:0/3975594559 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 -- 172.21.15.113:0/3975594559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 msgr2=0x7f1cec0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1cea59c640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.522+0000 7f1ceb59e640 1 -- 172.21.15.113:0/3975594559 >> v1:172.21.15.152:6789/0 conn(0x7f1cec15abb0 legacy=0x7f1cec0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.523+0000 7f1ceb59e640 1 -- 172.21.15.113:0/3975594559 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0cb970 con 0x7f1cec0cd210 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.523+0000 7f1ceb59e640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec0cd6a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009e50 tx=0x7f1cdc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba174d51b756436 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.523+0000 7f1ce9d9b640 1 -- 172.21.15.113:0/3975594559 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc02cb00 con 0x7f1cec0cd210 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.523+0000 7f1ce9d9b640 1 -- 172.21.15.113:0/3975594559 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc02cca0 con 0x7f1cec0cd210 2024-02-26T12:19:26.509 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.523+0000 7f1ce9d9b640 1 -- 172.21.15.113:0/3975594559 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc034610 con 0x7f1cec0cd210 2024-02-26T12:19:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 -- 172.21.15.113:0/3975594559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 msgr2=0x7f1cec0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.510 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec0cd6a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009e50 tx=0x7f1cdc02bf60 comp rx=0 tx=0).stop 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 -- 172.21.15.113:0/3975594559 shutdown_connections 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec0cd6a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3975594559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 -- 172.21.15.113:0/3975594559 >> 172.21.15.113:0/3975594559 conn(0x7f1cec0d0770 msgr2=0x7f1cec0d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 -- 172.21.15.113:0/3975594559 shutdown_connections 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.524+0000 7f1cf122d640 1 -- 172.21.15.113:0/3975594559 wait complete. 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.525+0000 7f1cf122d640 1 Processor -- start 2024-02-26T12:19:26.511 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.525+0000 7f1cf122d640 1 -- start start 2024-02-26T12:19:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cec15abb0 0x7f1cec0c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cdbe0 con 0x7f1cec0cd210 2024-02-26T12:19:26.513 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cb380 con 0x7f1cec15abb0 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cf122d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c7d80 con 0x7f1cec0ced20 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38524/0 (socket says 172.21.15.113:38524) 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 -- 172.21.15.113:0/3490033427 learned_addr learned my addr 172.21.15.113:0/3490033427 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1ceb59e640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cec15abb0 0x7f1cec0c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cea59c640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 -- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 msgr2=0x7f1cec0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.526+0000 7f1cead9d640 1 -- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cec15abb0 msgr2=0x7f1cec0c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cead9d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cec15abb0 0x7f1cec0c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cead9d640 1 -- 172.21.15.113:0/3490033427 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0c8000 con 0x7f1cec0cd210 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cea59c640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cead9d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b420 tx=0x7f1ce400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4011830 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4016070 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0c82e0 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4011c10 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.527+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec0c88a0 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.528+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec074a50 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.528+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ce401b460 con 0x7f1cec0cd210 2024-02-26T12:19:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.529+0000 7f1cd37fe640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.529+0000 7f1cea59c640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.529+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ce4089be0 con 0x7f1cec0cd210 2024-02-26T12:19:26.516 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.529+0000 7f1cea59c640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 0x7f1cd806d9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1cec1e7300 tx=0x7f1ce0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.533+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ce4020020 con 0x7f1cec0cd210 2024-02-26T12:19:26.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.739+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1cec0cd7d0 con 0x7f1cec0cd210 2024-02-26T12:19:26.724 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.739+0000 7f1cd37fe640 1 -- 172.21.15.113:0/3490033427 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1ce40589e0 con 0x7f1cec0cd210 2024-02-26T12:19:26.724 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:26.725 INFO:teuthology.orchestra.run.smithi113.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 msgr2=0x7f1cd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 0x7f1cd806d9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1cec1e7300 tx=0x7f1ce0008040 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 msgr2=0x7f1cec15db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b420 tx=0x7f1ce400b8e0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 shutdown_connections 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1cd806b500 0x7f1cd806d9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cec15abb0 0x7f1cec0c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1cec0ced20 0x7f1cec0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 --2- 172.21.15.113:0/3490033427 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1cec0cd210 0x7f1cec15db80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 >> 172.21.15.113:0/3490033427 conn(0x7f1cec0d0770 msgr2=0x7f1cec0ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 shutdown_connections 2024-02-26T12:19:26.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.741+0000 7f1cf122d640 1 -- 172.21.15.113:0/3490033427 wait complete. 2024-02-26T12:19:26.737 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-26T12:19:26.738 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 Processor -- start 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 -- start start 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 0x7f67440715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f674406eb70 0x7f67440cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67440cf670 con 0x7f6744071b10 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6744145840 con 0x7f674406eb70 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.853+0000 7f674aa20640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67440cf950 con 0x7f67440711f0 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f674406eb70 0x7f67440cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f674406eb70 0x7f67440cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38534/0 (socket says 172.21.15.113:38534) 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 -- 172.21.15.113:0/3178925035 learned_addr learned my addr 172.21.15.113:0/3178925035 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6743fff640 1 --2- 172.21.15.113:0/3178925035 >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 0x7f67440715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 -- 172.21.15.113:0/3178925035 >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 msgr2=0x7f67440715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 --2- 172.21.15.113:0/3178925035 >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 0x7f67440715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 -- 172.21.15.113:0/3178925035 >> v1:172.21.15.152:6789/0 conn(0x7f6744071b10 legacy=0x7f67440ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6748fbd640 1 -- 172.21.15.113:0/3178925035 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440cfc30 con 0x7f674406eb70 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.854+0000 7f6743fff640 1 --2- 172.21.15.113:0/3178925035 >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 0x7f67440715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f6748fbd640 1 --2- 172.21.15.113:0/3178925035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f67440cf030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67440b4d40 tx=0x7f673c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db5110e3e13c701 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f6742ffd640 1 -- 172.21.15.113:0/3178925035 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c02ca80 con 0x7f674406eb70 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f6742ffd640 1 -- 172.21.15.113:0/3178925035 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c02cc20 con 0x7f674406eb70 2024-02-26T12:19:26.841 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f6742ffd640 1 -- 172.21.15.113:0/3178925035 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0343f0 con 0x7f674406eb70 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 -- 172.21.15.113:0/3178925035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 msgr2=0x7f67440cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 --2- 172.21.15.113:0/3178925035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f67440cf030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f67440b4d40 tx=0x7f673c02bee0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 -- 172.21.15.113:0/3178925035 shutdown_connections 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 --2- 172.21.15.113:0/3178925035 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f67440cf030 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 --2- 172.21.15.113:0/3178925035 >> v2:172.21.15.152:3300/0 conn(0x7f67440711f0 0x7f67440715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 -- 172.21.15.113:0/3178925035 >> 172.21.15.113:0/3178925035 conn(0x7f674406ab50 msgr2=0x7f674406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 -- 172.21.15.113:0/3178925035 shutdown_connections 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.855+0000 7f674aa20640 1 -- 172.21.15.113:0/3178925035 wait complete. 2024-02-26T12:19:26.845 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.856+0000 7f674aa20640 1 Processor -- start 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 -- start start 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67440711f0 0x7f67441365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 0x7f67440b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6744165680 con 0x7f674406eb70 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6744071fc0 con 0x7f6744071b10 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f674aa20640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6744165800 con 0x7f67440711f0 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f6743fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f6743fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38550/0 (socket says 172.21.15.113:38550) 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f6743fff640 1 -- 172.21.15.113:0/2379331758 learned_addr learned my addr 172.21.15.113:0/2379331758 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f6748fbd640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 0x7f67440b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.857+0000 7f67437fe640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67440711f0 0x7f67441365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 -- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67440711f0 msgr2=0x7f67441365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67440711f0 0x7f67441365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 -- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 msgr2=0x7f67440b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 0x7f67440b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 -- 172.21.15.113:0/2379331758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674415ba30 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6748fbd640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 0x7f67440b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6743fff640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f673400e760 tx=0x7f673400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400f040 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734004230 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400ee70 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674413e8a0 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.858+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674413ee60 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.859+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6744074a50 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.859+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f673400c6d0 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.860+0000 7f6740ff9640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 0x7f673006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.860+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f673408a2c0 con 0x7f674406eb70 2024-02-26T12:19:26.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.860+0000 7f67437fe640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 0x7f673006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:26.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.860+0000 7f67437fe640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 0x7f673006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6738006fd0 tx=0x7f6738008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:26.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:26.864+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6734017020 con 0x7f674406eb70 2024-02-26T12:19:27.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.036+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f674415e7e0 con 0x7f674406eb70 2024-02-26T12:19:27.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.037+0000 7f6740ff9640 1 -- 172.21.15.113:0/2379331758 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f6734059140 con 0x7f674406eb70 2024-02-26T12:19:27.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:27.023 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 msgr2=0x7f673006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 0x7f673006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6738006fd0 tx=0x7f6738008040 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 msgr2=0x7f674413e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f673400e760 tx=0x7f673400ec20 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 shutdown_connections 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f673006b4d0 0x7f673006d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6744071b10 0x7f67440b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67440711f0 0x7f67441365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 --2- 172.21.15.113:0/2379331758 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f674406eb70 0x7f674413e1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 >> 172.21.15.113:0/2379331758 conn(0x7f674406ab50 msgr2=0x7f67440b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 shutdown_connections 2024-02-26T12:19:27.026 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.039+0000 7f674aa20640 1 -- 172.21.15.113:0/2379331758 wait complete. 2024-02-26T12:19:27.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:27.036 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:27.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.153+0000 7ff672476640 1 Processor -- start 2024-02-26T12:19:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.153+0000 7ff672476640 1 -- start start 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff672476640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff66c09a090 0x7ff66c161a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff672476640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c162050 con 0x7ff66c099cb0 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff672476640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c162330 con 0x7ff66c0d13e0 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff672476640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c0cff40 con 0x7ff66c09a090 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66bfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff66c099cb0 0x7ff66c06bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58034/0 (socket says 172.21.15.113:58034) 2024-02-26T12:19:27.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66bfff640 1 -- 172.21.15.113:0/1773469499 learned_addr learned my addr 172.21.15.113:0/1773469499 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff670a13640 1 --2- 172.21.15.113:0/1773469499 >> v2:172.21.15.152:3300/0 conn(0x7ff66c09a090 0x7ff66c161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144824686 0 0) 0x7ff66c162050 con 0x7ff66c099cb0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff654003520 con 0x7ff66c099cb0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593920525 0 0) 0x7ff654003520 con 0x7ff66c099cb0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 >> v2:172.21.15.152:3300/0 conn(0x7ff66c09a090 msgr2=0x7ff66c161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 --2- 172.21.15.113:0/1773469499 >> v2:172.21.15.152:3300/0 conn(0x7ff66c09a090 0x7ff66c161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 >> v1:172.21.15.152:6789/0 conn(0x7ff66c0d13e0 legacy=0x7ff66c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c162610 con 0x7ff66c099cb0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.154+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7ff65c001670 con 0x7ff66c099cb0 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 >> v1:172.21.15.113:6789/0 conn(0x7ff66c099cb0 legacy=0x7ff66c06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6540039b0 0x7ff654003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 0x7ff654004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6540051c0 0x7ff65400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0cff40 con 0x7ff654004800 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400c060 con 0x7ff6540039b0 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65400c260 con 0x7ff6540051c0 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 0x7ff654004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66bfff640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6540039b0 0x7ff654003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff670a13640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6540051c0 0x7ff65400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 -- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6540051c0 msgr2=0x7ff65400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6540051c0 0x7ff65400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 -- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6540039b0 msgr2=0x7ff654003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6540039b0 0x7ff654003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff66b7fe640 1 -- 172.21.15.113:0/1773469499 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654003520 con 0x7ff654004800 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.155+0000 7ff670a13640 1 -- 172.21.15.113:0/1773469499 reap_dead start 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff66b7fe640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 0x7ff654004c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff660001750 tx=0x7ff654005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faec636c7f391662 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660001370 con 0x7ff654004800 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600052d0 con 0x7ff654004800 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff66affd640 1 -- 172.21.15.113:0/1773469499 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660003830 con 0x7ff654004800 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 -- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 msgr2=0x7ff654004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 0x7ff654004c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff660001750 tx=0x7ff654005830 comp rx=0 tx=0).stop 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 -- 172.21.15.113:0/1773469499 shutdown_connections 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 --2- 172.21.15.113:0/1773469499 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff654004800 0x7ff654004c80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 -- 172.21.15.113:0/1773469499 >> 172.21.15.113:0/1773469499 conn(0x7ff66c0b34b0 msgr2=0x7ff66c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 -- 172.21.15.113:0/1773469499 shutdown_connections 2024-02-26T12:19:27.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.156+0000 7ff672476640 1 -- 172.21.15.113:0/1773469499 wait complete. 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.157+0000 7ff672476640 1 Processor -- start 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 -- start start 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff654004800 0x7ff66c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff66c0c6b60 0x7ff66c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c161bf0 con 0x7ff66c0b66d0 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c161a70 con 0x7ff654004800 2024-02-26T12:19:27.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff672476640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c161d70 con 0x7ff66c0c6b60 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff670a13640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.158+0000 7ff670a13640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38562/0 (socket says 172.21.15.113:38562) 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 -- 172.21.15.113:0/4044357282 learned_addr learned my addr 172.21.15.113:0/4044357282 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff66b7fe640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff66c0c6b60 0x7ff66c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff66bfff640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff654004800 0x7ff66c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 -- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff66c0c6b60 msgr2=0x7ff66c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff66c0c6b60 0x7ff66c152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 -- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff654004800 msgr2=0x7ff66c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff654004800 0x7ff66c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 -- 172.21.15.113:0/4044357282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0c8100 con 0x7ff66c0b66d0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff670a13640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0674e0 tx=0x7ff6640115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011e10 con 0x7ff66c0b66d0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66401b070 con 0x7ff66c0b66d0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0c6080 con 0x7ff66c0b66d0 2024-02-26T12:19:27.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664003990 con 0x7ff66c0b66d0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.159+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c0c6640 con 0x7ff66c0b66d0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.160+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c0706d0 con 0x7ff66c0b66d0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.161+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff664003b50 con 0x7ff66c0b66d0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.161+0000 7ff668ff9640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 0x7ff65806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.161+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff66408aa50 con 0x7ff66c0b66d0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.161+0000 7ff66bfff640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 0x7ff65806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.161+0000 7ff66bfff640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 0x7ff65806d9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff66c1f7360 tx=0x7ff65c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.165+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff66c0706d0 con 0x7ff66c0b66d0 2024-02-26T12:19:27.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.337+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff66c074a50 con 0x7ff66c0b66d0 2024-02-26T12:19:27.323 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.337+0000 7ff668ff9640 1 -- 172.21.15.113:0/4044357282 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff664059960 con 0x7ff66c0b66d0 2024-02-26T12:19:27.323 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 msgr2=0x7ff65806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 0x7ff65806d9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff66c1f7360 tx=0x7ff65c009040 comp rx=0 tx=0).stop 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 msgr2=0x7ff66c0b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0674e0 tx=0x7ff6640115a0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 shutdown_connections 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff65806b500 0x7ff65806d9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.325 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.339+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff66c0b66d0 0x7ff66c0b6b50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.340+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff66c0c6b60 0x7ff66c152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.340+0000 7ff672476640 1 --2- 172.21.15.113:0/4044357282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff654004800 0x7ff66c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.340+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 >> 172.21.15.113:0/4044357282 conn(0x7ff66c0b34b0 msgr2=0x7ff66c0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.340+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 shutdown_connections 2024-02-26T12:19:27.326 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.340+0000 7ff672476640 1 -- 172.21.15.113:0/4044357282 wait complete. 2024-02-26T12:19:27.336 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:27.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.454+0000 7f4286ab0640 1 Processor -- start 2024-02-26T12:19:27.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.454+0000 7f4286ab0640 1 -- start start 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f4286ab0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f4286ab0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42800b5b50 0x7f42800ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f4286ab0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800d1dc0 con 0x7f42800ce930 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f4286ab0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800b5fb0 con 0x7f42800b5b50 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f4286ab0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cedc0 con 0x7f428015de30 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42800b5b50 0x7f42800ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f428504d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f42800ce930 0x7f428006c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58038/0 (socket says 172.21.15.113:58038) 2024-02-26T12:19:27.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42800b5b50 0x7f42800ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38578/0 (socket says 172.21.15.113:38578) 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f428504d640 1 -- 172.21.15.113:0/306187677 learned_addr learned my addr 172.21.15.113:0/306187677 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f428484c640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 -- 172.21.15.113:0/306187677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 msgr2=0x7f42800b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 -- 172.21.15.113:0/306187677 >> v1:172.21.15.113:6789/0 conn(0x7f42800ce930 legacy=0x7f428006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.455+0000 7f427ffff640 1 -- 172.21.15.113:0/306187677 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800cf000 con 0x7f42800b5b50 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.456+0000 7f427ffff640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f42800ce3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f426c0097a0 tx=0x7f426c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439a51c482747c3e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.456+0000 7f427f7fe640 1 -- 172.21.15.113:0/306187677 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c035020 con 0x7f42800b5b50 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.456+0000 7f427f7fe640 1 -- 172.21.15.113:0/306187677 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c031830 con 0x7f42800b5b50 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.456+0000 7f427f7fe640 1 -- 172.21.15.113:0/306187677 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c031c00 con 0x7f42800b5b50 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 -- 172.21.15.113:0/306187677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 msgr2=0x7f42800ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f42800ce3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f426c0097a0 tx=0x7f426c02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 -- 172.21.15.113:0/306187677 shutdown_connections 2024-02-26T12:19:27.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f42800ce3f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 --2- 172.21.15.113:0/306187677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 -- 172.21.15.113:0/306187677 >> 172.21.15.113:0/306187677 conn(0x7f42800d0610 msgr2=0x7f42800d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 -- 172.21.15.113:0/306187677 shutdown_connections 2024-02-26T12:19:27.444 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.457+0000 7f4286ab0640 1 -- 172.21.15.113:0/306187677 wait complete. 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.458+0000 7f4286ab0640 1 Processor -- start 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.458+0000 7f4286ab0640 1 -- start start 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42800ce930 0x7f42800cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800d2340 con 0x7f42800b5b50 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280161d50 con 0x7f42800ce930 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f4286ab0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800b6dc0 con 0x7f428015de30 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38588/0 (socket says 172.21.15.113:38588) 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 -- 172.21.15.113:0/1587860390 learned_addr learned my addr 172.21.15.113:0/1587860390 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f427ffff640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42800ce930 0x7f42800cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428504d640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 -- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 msgr2=0x7f42800d3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800d3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 -- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42800ce930 msgr2=0x7f42800cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42800ce930 0x7f42800cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 -- 172.21.15.113:0/1587860390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800cca90 con 0x7f42800b5b50 2024-02-26T12:19:27.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.459+0000 7f428484c640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f427400e870 tx=0x7f427400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.460+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274017070 con 0x7f42800b5b50 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.460+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427400c940 con 0x7f42800b5b50 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.460+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400cd30 con 0x7f42800b5b50 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.460+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42800ccd70 con 0x7f42800b5b50 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.460+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800cd330 con 0x7f42800b5b50 2024-02-26T12:19:27.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.461+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280074a50 con 0x7f42800b5b50 2024-02-26T12:19:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.461+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f427401a070 con 0x7f42800b5b50 2024-02-26T12:19:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.462+0000 7f427d7fa640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 0x7f426406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.462+0000 7f427ffff640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 0x7f426406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.462+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4274089fc0 con 0x7f42800b5b50 2024-02-26T12:19:27.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.462+0000 7f427ffff640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 0x7f426406d9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.467+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42740587f0 con 0x7f42800b5b50 2024-02-26T12:19:27.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.641+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42800d18d0 con 0x7f42800b5b50 2024-02-26T12:19:27.626 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.641+0000 7f427d7fa640 1 -- 172.21.15.113:0/1587860390 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f427405c890 con 0x7f42800b5b50 2024-02-26T12:19:27.627 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 msgr2=0x7f426406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 0x7f426406d9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 msgr2=0x7f428014e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f427400e870 tx=0x7f427400ed30 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 shutdown_connections 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f426406b500 0x7f426406d9c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f428015de30 0x7f42800d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42800ce930 0x7f42800cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 --2- 172.21.15.113:0/1587860390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42800b5b50 0x7f428014e6b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.629 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 >> 172.21.15.113:0/1587860390 conn(0x7f42800d0610 msgr2=0x7f42800b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 shutdown_connections 2024-02-26T12:19:27.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.643+0000 7f4286ab0640 1 -- 172.21.15.113:0/1587860390 wait complete. 2024-02-26T12:19:27.639 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:27.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.757+0000 7f30a70de640 1 Processor -- start 2024-02-26T12:19:27.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.757+0000 7f30a70de640 1 -- start start 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a70de640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30a015be30 0x7f30a009ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a70de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 0x7f30a00d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a70de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a0099d70 con 0x7f30a015ba50 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a70de640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a0099b20 con 0x7f30a015be30 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a70de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a009a050 con 0x7f30a00cff40 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f309ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30a015be30 0x7f30a009ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f309ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30a015be30 0x7f30a009ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38602/0 (socket says 172.21.15.113:38602) 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f309ffff640 1 -- 172.21.15.113:0/386338233 learned_addr learned my addr 172.21.15.113:0/386338233 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.758+0000 7f30a567b640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 0x7f30a00d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309ffff640 1 -- 172.21.15.113:0/386338233 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 msgr2=0x7f30a00d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309ffff640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 0x7f30a00d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309ffff640 1 -- 172.21.15.113:0/386338233 >> v1:172.21.15.152:6789/0 conn(0x7f30a015ba50 legacy=0x7f30a00ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309ffff640 1 -- 172.21.15.113:0/386338233 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a009a330 con 0x7f30a015be30 2024-02-26T12:19:27.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f30a567b640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 0x7f30a00d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:27.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309ffff640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009ab30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3094009870 tx=0x7f309402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6cd00e85ee4dbf server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309f7fe640 1 -- 172.21.15.113:0/386338233 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094034070 con 0x7f30a015be30 2024-02-26T12:19:27.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309f7fe640 1 -- 172.21.15.113:0/386338233 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094030840 con 0x7f30a015be30 2024-02-26T12:19:27.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.759+0000 7f309f7fe640 1 -- 172.21.15.113:0/386338233 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094030c10 con 0x7f30a015be30 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 -- 172.21.15.113:0/386338233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 msgr2=0x7f30a009ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009ab30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3094009870 tx=0x7f309402b980 comp rx=0 tx=0).stop 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 -- 172.21.15.113:0/386338233 shutdown_connections 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a00cff40 0x7f30a00d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 --2- 172.21.15.113:0/386338233 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009ab30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 -- 172.21.15.113:0/386338233 >> 172.21.15.113:0/386338233 conn(0x7f30a00b3450 msgr2=0x7f30a00b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 -- 172.21.15.113:0/386338233 shutdown_connections 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.760+0000 7f30a70de640 1 -- 172.21.15.113:0/386338233 wait complete. 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.761+0000 7f30a70de640 1 Processor -- start 2024-02-26T12:19:27.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.761+0000 7f30a70de640 1 -- start start 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 0x7f30a014d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a015ba50 0x7f30a009b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00cd690 con 0x7f30a015be30 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00cf6f0 con 0x7f30a00cff40 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a70de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a014deb0 con 0x7f30a015ba50 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38616/0 (socket says 172.21.15.113:38616) 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 -- 172.21.15.113:0/3810573538 learned_addr learned my addr 172.21.15.113:0/3810573538 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a4e7a640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 0x7f30a014d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f309ffff640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a015ba50 0x7f30a009b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 -- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a015ba50 msgr2=0x7f30a009b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a015ba50 0x7f30a009b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 -- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 msgr2=0x7f30a014d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.762+0000 7f30a567b640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 0x7f30a014d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f30a567b640 1 -- 172.21.15.113:0/3810573538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a014e390 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f30a4e7a640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 0x7f30a014d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f30a567b640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fa0 tx=0x7f309800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309801a070 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098003bb0 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00ca660 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004030 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.763+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00cac20 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.764+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a0074a50 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.764+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f309801d070 con 0x7f30a015be30 2024-02-26T12:19:27.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.765+0000 7f309d7fa640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 0x7f308c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:27.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.765+0000 7f30a4e7a640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 0x7f308c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:27.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.765+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f309808a4b0 con 0x7f30a015be30 2024-02-26T12:19:27.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.765+0000 7f30a4e7a640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 0x7f308c06d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3090001700 tx=0x7f3090009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:27.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.769+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30a014e390 con 0x7f30a015be30 2024-02-26T12:19:27.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.939+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30a00cbd20 con 0x7f30a015be30 2024-02-26T12:19:27.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.939+0000 7f309d7fa640 1 -- 172.21.15.113:0/3810573538 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3098010070 con 0x7f30a015be30 2024-02-26T12:19:27.925 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:27.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 msgr2=0x7f308c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 0x7f308c06d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3090001700 tx=0x7f3090009040 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 msgr2=0x7f30a009bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fa0 tx=0x7f309800d560 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 shutdown_connections 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f308c06b4d0 0x7f308c06d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30a015be30 0x7f30a009bbc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f30a015ba50 0x7f30a009b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 --2- 172.21.15.113:0/3810573538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30a00cff40 0x7f30a014d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 >> 172.21.15.113:0/3810573538 conn(0x7f30a00b3450 msgr2=0x7f30a0070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 shutdown_connections 2024-02-26T12:19:27.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:27.941+0000 7f30a70de640 1 -- 172.21.15.113:0/3810573538 wait complete. 2024-02-26T12:19:27.937 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:28.037 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.052+0000 7f1ae631e640 1 Processor -- start 2024-02-26T12:19:28.037 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.052+0000 7f1ae631e640 1 -- start start 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae631e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1ae015dc00 0x7f1ae00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae631e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ae00aee10 0x7f1ae0162200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae631e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00717d0 con 0x7f1ae00ace00 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae631e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae006dcf0 con 0x7f1ae00aee10 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae631e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae0071ab0 con 0x7f1ae015dc00 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ae00aee10 0x7f1ae0162200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1ae00aee10 0x7f1ae0162200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38628/0 (socket says 172.21.15.113:38628) 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 -- 172.21.15.113:0/2259904384 learned_addr learned my addr 172.21.15.113:0/2259904384 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1adf7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1ae00ace00 0x7f1ae00ae700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:58052/0 (socket says 172.21.15.113:58052) 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1adffff640 1 --2- 172.21.15.113:0/2259904384 >> v2:172.21.15.152:3300/0 conn(0x7f1ae015dc00 0x7f1ae00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 -- 172.21.15.113:0/2259904384 >> v2:172.21.15.152:3300/0 conn(0x7f1ae015dc00 msgr2=0x7f1ae00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 --2- 172.21.15.113:0/2259904384 >> v2:172.21.15.152:3300/0 conn(0x7f1ae015dc00 0x7f1ae00711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 -- 172.21.15.113:0/2259904384 >> v1:172.21.15.113:6789/0 conn(0x7f1ae00ace00 legacy=0x7f1ae00ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1ae48bb640 1 -- 172.21.15.113:0/2259904384 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0071d90 con 0x7f1ae00aee10 2024-02-26T12:19:28.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.053+0000 7f1adeffd640 1 -- 172.21.15.113:0/2259904384 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018305437 0 0) 0x7f1ae00717d0 con 0x7f1ae00ace00 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.054+0000 7f1ae48bb640 1 --2- 172.21.15.113:0/2259904384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00aee10 0x7f1ae0162200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ae006f530 tx=0x7f1ad802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7cba6fbb75f3ab server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.054+0000 7f1adeffd640 1 -- 172.21.15.113:0/2259904384 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad802cb20 con 0x7f1ae00aee10 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.054+0000 7f1adeffd640 1 -- 172.21.15.113:0/2259904384 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad802ccc0 con 0x7f1ae00aee10 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.054+0000 7f1adeffd640 1 -- 172.21.15.113:0/2259904384 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8034610 con 0x7f1ae00aee10 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 -- 172.21.15.113:0/2259904384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00aee10 msgr2=0x7f1ae0162200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 --2- 172.21.15.113:0/2259904384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00aee10 0x7f1ae0162200 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1ae006f530 tx=0x7f1ad802bf80 comp rx=0 tx=0).stop 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 -- 172.21.15.113:0/2259904384 shutdown_connections 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 --2- 172.21.15.113:0/2259904384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00aee10 0x7f1ae0162200 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 --2- 172.21.15.113:0/2259904384 >> v2:172.21.15.152:3300/0 conn(0x7f1ae015dc00 0x7f1ae00711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 -- 172.21.15.113:0/2259904384 >> 172.21.15.113:0/2259904384 conn(0x7f1ae006ab50 msgr2=0x7f1ae006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 -- 172.21.15.113:0/2259904384 shutdown_connections 2024-02-26T12:19:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.055+0000 7f1ae631e640 1 -- 172.21.15.113:0/2259904384 wait complete. 2024-02-26T12:19:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.056+0000 7f1ae631e640 1 Processor -- start 2024-02-26T12:19:28.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.056+0000 7f1ae631e640 1 -- start start 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1ae00aee10 0x7f1ae00cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ae015dc00 0x7f1ae00cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae015e160 con 0x7f1ae00ace00 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae015dfe0 con 0x7f1ae015dc00 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae015e2e0 con 0x7f1ae00aee10 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38638/0 (socket says 172.21.15.113:38638) 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 -- 172.21.15.113:0/1047588642 learned_addr learned my addr 172.21.15.113:0/1047588642 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adf7fe640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1ae00aee10 0x7f1ae00cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae48bb640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ae015dc00 0x7f1ae00cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 -- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1ae00aee10 msgr2=0x7f1ae00cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1ae00aee10 0x7f1ae00cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 -- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ae015dc00 msgr2=0x7f1ae00cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ae015dc00 0x7f1ae00cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 -- 172.21.15.113:0/1047588642 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00af300 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adffff640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c820 tx=0x7f1ad000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0015070 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0004020 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae00af5e0 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.057+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00043f0 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.058+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae00afba0 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.058+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0074a50 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.059+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ad0007830 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.059+0000 7f1adcff9640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 0x7f1acc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.059+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ad008a020 con 0x7f1ae00ace00 2024-02-26T12:19:28.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.059+0000 7f1adf7fe640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 0x7f1acc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.060+0000 7f1adf7fe640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 0x7f1acc06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00ce5f0 tx=0x7f1ad4007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.063+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ad0058ea0 con 0x7f1ae00ace00 2024-02-26T12:19:28.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.270+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ae0160ed0 con 0x7f1ae00ace00 2024-02-26T12:19:28.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.270+0000 7f1adcff9640 1 -- 172.21.15.113:0/1047588642 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f1ad00587a0 con 0x7f1ae00ace00 2024-02-26T12:19:28.256 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:28.256 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:28.256 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 msgr2=0x7f1acc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 0x7f1acc06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00ce5f0 tx=0x7f1ad4007b90 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 msgr2=0x7f1ae0155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000c820 tx=0x7f1ad000cce0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 shutdown_connections 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1acc06b4d0 0x7f1acc06d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1ae015dc00 0x7f1ae00cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1ae00aee10 0x7f1ae00cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 --2- 172.21.15.113:0/1047588642 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ae00ace00 0x7f1ae0155810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 >> 172.21.15.113:0/1047588642 conn(0x7f1ae006ab50 msgr2=0x7f1ae0158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 shutdown_connections 2024-02-26T12:19:28.258 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.272+0000 7f1ae631e640 1 -- 172.21.15.113:0/1047588642 wait complete. 2024-02-26T12:19:28.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:28.368 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.382+0000 7fd0f4174640 1 Processor -- start 2024-02-26T12:19:28.368 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 -- start start 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 0x7fd0ec0cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cf6c0 con 0x7fd0ec0cd210 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cdf90 con 0x7fd0ec0ced20 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f4174640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cb690 con 0x7fd0ec15abb0 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f2711640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f2711640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38646/0 (socket says 172.21.15.113:38646) 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.383+0000 7fd0f2711640 1 -- 172.21.15.113:0/1084191409 learned_addr learned my addr 172.21.15.113:0/1084191409 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f1f10640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f170f640 1 --2- 172.21.15.113:0/1084191409 >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 0x7fd0ec0cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 -- 172.21.15.113:0/1084191409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 msgr2=0x7fd0ec0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 -- 172.21.15.113:0/1084191409 >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 msgr2=0x7fd0ec0cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 --2- 172.21.15.113:0/1084191409 >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 0x7fd0ec0cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 -- 172.21.15.113:0/1084191409 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0cb970 con 0x7fd0ec0cd210 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f170f640 1 --2- 172.21.15.113:0/1084191409 >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 0x7fd0ec0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.384+0000 7fd0f2711640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec073430 tx=0x7fd0e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9d8e3bd95670e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f0f0e640 1 -- 172.21.15.113:0/1084191409 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4034070 con 0x7fd0ec0cd210 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f0f0e640 1 -- 172.21.15.113:0/1084191409 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4030860 con 0x7fd0ec0cd210 2024-02-26T12:19:28.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f0f0e640 1 -- 172.21.15.113:0/1084191409 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4030c30 con 0x7fd0ec0cd210 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 -- 172.21.15.113:0/1084191409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 msgr2=0x7fd0ec0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec073430 tx=0x7fd0e402b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 -- 172.21.15.113:0/1084191409 shutdown_connections 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec0cd6a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 --2- 172.21.15.113:0/1084191409 >> v2:172.21.15.152:3300/0 conn(0x7fd0ec0ced20 0x7fd0ec0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 --2- 172.21.15.113:0/1084191409 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 -- 172.21.15.113:0/1084191409 >> 172.21.15.113:0/1084191409 conn(0x7fd0ec0d0770 msgr2=0x7fd0ec0d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 -- 172.21.15.113:0/1084191409 shutdown_connections 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.385+0000 7fd0f4174640 1 -- 172.21.15.113:0/1084191409 wait complete. 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.386+0000 7fd0f4174640 1 Processor -- start 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 -- start start 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0ec0ced20 0x7fd0ec0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cc6b0 con 0x7fd0ec0cd210 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cb380 con 0x7fd0ec0ced20 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f4174640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cdbe0 con 0x7fd0ec15abb0 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f1f10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f1f10640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:38652/0 (socket says 172.21.15.113:38652) 2024-02-26T12:19:28.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f1f10640 1 -- 172.21.15.113:0/3402585235 learned_addr learned my addr 172.21.15.113:0/3402585235 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f170f640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0ec0ced20 0x7fd0ec0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.387+0000 7fd0f2711640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 -- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 msgr2=0x7fd0ec0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 -- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0ec0ced20 msgr2=0x7fd0ec0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0ec0ced20 0x7fd0ec0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 -- 172.21.15.113:0/3402585235 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0b34a0 con 0x7fd0ec0cd210 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f1f10640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800efc0 tx=0x7fd0e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8018020 con 0x7fd0ec0cd210 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8014480 con 0x7fd0ec0cd210 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec0b3780 con 0x7fd0ec0cd210 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8014850 con 0x7fd0ec0cd210 2024-02-26T12:19:28.376 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.388+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec0b3d40 con 0x7fd0ec0cd210 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.389+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec0685c0 con 0x7fd0ec0cd210 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.389+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0e801b020 con 0x7fd0ec0cd210 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.390+0000 7fd0e27fc640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 0x7fd0d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.390+0000 7fd0f170f640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 0x7fd0d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.390+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e808b140 con 0x7fd0ec0cd210 2024-02-26T12:19:28.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.390+0000 7fd0f170f640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 0x7fd0d006d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc006fd0 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.394+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0ec0685c0 con 0x7fd0ec0cd210 2024-02-26T12:19:28.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.567+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0ec074a50 con 0x7fd0ec0cd210 2024-02-26T12:19:28.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.568+0000 7fd0e27fc640 1 -- 172.21.15.113:0/3402585235 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fd0e8022020 con 0x7fd0ec0cd210 2024-02-26T12:19:28.553 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:28.553 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.569+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 msgr2=0x7fd0d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.569+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 0x7fd0d006d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc006fd0 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2024-02-26T12:19:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 msgr2=0x7fd0ec153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800efc0 tx=0x7fd0e800c490 comp rx=0 tx=0).stop 2024-02-26T12:19:28.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 shutdown_connections 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd0d006b4d0 0x7fd0d006d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0ec15abb0 0x7fd0ec0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0ec0ced20 0x7fd0ec0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 --2- 172.21.15.113:0/3402585235 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0ec0cd210 0x7fd0ec153c80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 >> 172.21.15.113:0/3402585235 conn(0x7fd0ec0d0770 msgr2=0x7fd0ec0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 shutdown_connections 2024-02-26T12:19:28.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.570+0000 7fd0f4174640 1 -- 172.21.15.113:0/3402585235 wait complete. 2024-02-26T12:19:28.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:28.566 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:28.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.684+0000 7f8c41dbb640 1 Processor -- start 2024-02-26T12:19:28.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.684+0000 7f8c41dbb640 1 -- start start 2024-02-26T12:19:28.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8c3c0b0970 0x7f8c3c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c099a40 0x7f8c3c099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c09a3f0 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d09c0 con 0x7f8c3c0b0970 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c41dbb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0d0400 con 0x7f8c3c099a40 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34172/0 (socket says 172.21.15.113:34172) 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 -- 172.21.15.113:0/1043605256 learned_addr learned my addr 172.21.15.113:0/1043605256 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 -- 172.21.15.113:0/1043605256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c099a40 msgr2=0x7f8c3c099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/1043605256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c099a40 0x7f8c3c099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 -- 172.21.15.113:0/1043605256 >> v2:172.21.15.152:3300/0 conn(0x7f8c3c0b0970 msgr2=0x7f8c3c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/1043605256 >> v2:172.21.15.152:3300/0 conn(0x7f8c3c0b0970 0x7f8c3c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.685+0000 7f8c3b7fe640 1 -- 172.21.15.113:0/1043605256 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0d06e0 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.686+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/1043605256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c06f020 tx=0x7f8c2c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3990cb9dbc3f33e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.686+0000 7f8c3a7fc640 1 -- 172.21.15.113:0/1043605256 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c038070 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.686+0000 7f8c3a7fc640 1 -- 172.21.15.113:0/1043605256 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c02f050 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.686+0000 7f8c3a7fc640 1 -- 172.21.15.113:0/1043605256 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c031970 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 -- 172.21.15.113:0/1043605256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c15e1d0 msgr2=0x7f8c3c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/1043605256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c06f020 tx=0x7f8c2c02b7f0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 -- 172.21.15.113:0/1043605256 shutdown_connections 2024-02-26T12:19:28.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/1043605256 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c099a40 0x7f8c3c099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/1043605256 >> v2:172.21.15.152:3300/0 conn(0x7f8c3c0b0970 0x7f8c3c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/1043605256 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cf7e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 -- 172.21.15.113:0/1043605256 >> 172.21.15.113:0/1043605256 conn(0x7f8c3c0b33d0 msgr2=0x7f8c3c0b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 -- 172.21.15.113:0/1043605256 shutdown_connections 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.687+0000 7f8c41dbb640 1 -- 172.21.15.113:0/1043605256 wait complete. 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.688+0000 7f8c41dbb640 1 Processor -- start 2024-02-26T12:19:28.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.688+0000 7f8c41dbb640 1 -- start start 2024-02-26T12:19:28.676 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3c099a40 0x7f8c3c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0cbf30 con 0x7f8c3c0b0970 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06d930 con 0x7f8c3c099a40 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c41dbb640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0cc0b0 con 0x7f8c3c15e1d0 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34174/0 (socket says 172.21.15.113:34174) 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 -- 172.21.15.113:0/2562161652 learned_addr learned my addr 172.21.15.113:0/2562161652 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3c099a40 0x7f8c3c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3bfff640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 -- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c15e1d0 msgr2=0x7f8c3c0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 -- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3c099a40 msgr2=0x7f8c3c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3c099a40 0x7f8c3c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 -- 172.21.15.113:0/2562161652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c15c070 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c3affd640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b4a0 tx=0x7f8c3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.689+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30014070 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.690+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c30010610 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.690+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c15c310 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.690+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30010a00 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.690+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c15c8d0 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.690+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c074a50 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.691+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c30017070 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.691+0000 7f8c23fff640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 0x7f8c2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.691+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c30089b70 con 0x7f8c3c0b0970 2024-02-26T12:19:28.678 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.691+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 0x7f8c2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.692+0000 7f8c3b7fe640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 0x7f8c2806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c035000 tx=0x7f8c2c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.681 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.696+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c300583a0 con 0x7f8c3c0b0970 2024-02-26T12:19:28.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.865+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c3c06d3d0 con 0x7f8c3c0b0970 2024-02-26T12:19:28.850 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.865+0000 7f8c23fff640 1 -- 172.21.15.113:0/2562161652 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c3005c440 con 0x7f8c3c0b0970 2024-02-26T12:19:28.851 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:28.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 msgr2=0x7f8c2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 0x7f8c2806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c035000 tx=0x7f8c2c008030 comp rx=0 tx=0).stop 2024-02-26T12:19:28.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 msgr2=0x7f8c3c15d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b4a0 tx=0x7f8c3000b960 comp rx=0 tx=0).stop 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 shutdown_connections 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8c2806b4d0 0x7f8c2806d990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8c3c15e1d0 0x7f8c3c0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c3c0b0970 0x7f8c3c15d0d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 --2- 172.21.15.113:0/2562161652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c3c099a40 0x7f8c3c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 >> 172.21.15.113:0/2562161652 conn(0x7f8c3c0b33d0 msgr2=0x7f8c3c06fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 shutdown_connections 2024-02-26T12:19:28.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.867+0000 7f8c41dbb640 1 -- 172.21.15.113:0/2562161652 wait complete. 2024-02-26T12:19:28.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:28.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.980+0000 7f3ab55e9640 1 Processor -- start 2024-02-26T12:19:28.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.980+0000 7f3ab55e9640 1 -- start start 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3ab55e9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3ab55e9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ab00ceb00 0x7f3ab00d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3ab55e9640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00d1dc0 con 0x7f3ab00b5b50 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3ab55e9640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00b5fb0 con 0x7f3ab00ceb00 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3ab55e9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0161d50 con 0x7f3ab015de30 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaf7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3ab00ceb00 0x7f3ab00d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aa7fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3ab00b5b50 0x7f3ab00ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33368/0 (socket says 172.21.15.113:33368) 2024-02-26T12:19:28.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aa7fff640 1 -- 172.21.15.113:0/1109443129 learned_addr learned my addr 172.21.15.113:0/1109443129 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaeffd640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaf7fe640 1 -- 172.21.15.113:0/1109443129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 msgr2=0x7f3ab00b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaf7fe640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab00b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaf7fe640 1 -- 172.21.15.113:0/1109443129 >> v1:172.21.15.113:6789/0 conn(0x7f3ab00b5b50 legacy=0x7f3ab00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aae7fc640 1 -- 172.21.15.113:0/1109443129 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231284674 0 0) 0x7f3ab00d1dc0 con 0x7f3ab00b5b50 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.981+0000 7f3aaf7fe640 1 -- 172.21.15.113:0/1109443129 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00cf000 con 0x7f3ab00ceb00 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3aaf7fe640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00d2860 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cd3dcd33f51274 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3aae7fc640 1 -- 172.21.15.113:0/1109443129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8039070 con 0x7f3ab00ceb00 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3aae7fc640 1 -- 172.21.15.113:0/1109443129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa802cc50 con 0x7f3ab00ceb00 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3aae7fc640 1 -- 172.21.15.113:0/1109443129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8034440 con 0x7f3ab00ceb00 2024-02-26T12:19:28.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1109443129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 msgr2=0x7f3ab00d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00d2860 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa802bea0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1109443129 shutdown_connections 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00d2860 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1109443129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab00b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1109443129 >> 172.21.15.113:0/1109443129 conn(0x7f3ab00d0610 msgr2=0x7f3ab00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.982+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1109443129 shutdown_connections 2024-02-26T12:19:28.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.983+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1109443129 wait complete. 2024-02-26T12:19:28.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 Processor -- start 2024-02-26T12:19:28.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 -- start start 2024-02-26T12:19:28.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 0x7f3ab014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab0160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b6dc0 con 0x7f3ab00ceb00 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00d2340 con 0x7f3ab00b5b50 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3ab55e9640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab015e210 con 0x7f3ab015de30 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3aa7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3aa7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34196/0 (socket says 172.21.15.113:34196) 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3aa7fff640 1 -- 172.21.15.113:0/1196103288 learned_addr learned my addr 172.21.15.113:0/1196103288 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.984+0000 7f3aaeffd640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 0x7f3ab014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aaf7fe640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab0160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 -- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 msgr2=0x7f3ab0160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab0160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 -- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 msgr2=0x7f3ab014cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 0x7f3ab014cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 -- 172.21.15.113:0/1196103288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab014d270 con 0x7f3ab00ceb00 2024-02-26T12:19:28.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aaf7fe640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab0160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aaeffd640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 0x7f3ab014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa7fff640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c430 tx=0x7f3a9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a980074e0 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a980047e0 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00cb040 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98004bd0 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.985+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00cb600 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.986+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab015d970 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.986+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a98011070 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.987+0000 7f3aa77fe640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 0x7f3a9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.987+0000 7f3aaeffd640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 0x7f3a9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.987+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a98089e20 con 0x7f3ab00ceb00 2024-02-26T12:19:28.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.987+0000 7f3aaeffd640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 0x7f3a9006d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:28.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:28.991+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a9800e280 con 0x7f3ab00ceb00 2024-02-26T12:19:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.160+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ab0074a50 con 0x7f3ab00ceb00 2024-02-26T12:19:29.147 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.161+0000 7f3aa77fe640 1 -- 172.21.15.113:0/1196103288 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a98058ca0 con 0x7f3ab00ceb00 2024-02-26T12:19:29.147 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.162+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 msgr2=0x7f3a9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.162+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 0x7f3a9006d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0006fd0 tx=0x7f3aa0008040 comp rx=0 tx=0).stop 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.162+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 msgr2=0x7f3ab00cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.162+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c430 tx=0x7f3a9800c8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 shutdown_connections 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a9006b500 0x7f3a9006d9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ab015de30 0x7f3ab0160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3ab00ceb00 0x7f3ab00cc0e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 --2- 172.21.15.113:0/1196103288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ab00b5b50 0x7f3ab014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 >> 172.21.15.113:0/1196103288 conn(0x7f3ab00d0610 msgr2=0x7f3ab015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 shutdown_connections 2024-02-26T12:19:29.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.163+0000 7f3ab55e9640 1 -- 172.21.15.113:0/1196103288 wait complete. 2024-02-26T12:19:29.160 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:29.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.276+0000 7f1c25b15640 1 Processor -- start 2024-02-26T12:19:29.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.276+0000 7f1c25b15640 1 -- start start 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c25b15640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1c2015de20 0x7f1c200cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c25b15640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c200cff40 0x7f1c20162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c25b15640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2015e200 con 0x7f1c200cc900 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c25b15640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200ce0a0 con 0x7f1c200cff40 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c25b15640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c200cdc10 con 0x7f1c2015de20 2024-02-26T12:19:29.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c200cff40 0x7f1c20162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c200cff40 0x7f1c20162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34198/0 (socket says 172.21.15.113:34198) 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 -- 172.21.15.113:0/872787699 learned_addr learned my addr 172.21.15.113:0/872787699 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 -- 172.21.15.113:0/872787699 >> v2:172.21.15.152:3300/0 conn(0x7f1c2015de20 msgr2=0x7f1c200cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 --2- 172.21.15.113:0/872787699 >> v2:172.21.15.152:3300/0 conn(0x7f1c2015de20 0x7f1c200cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 -- 172.21.15.113:0/872787699 >> v1:172.21.15.152:6789/0 conn(0x7f1c200cc900 legacy=0x7f1c201618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.277+0000 7f1c1ffff640 1 -- 172.21.15.113:0/872787699 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2006b6f0 con 0x7f1c200cff40 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.278+0000 7f1c1ffff640 1 --2- 172.21.15.113:0/872787699 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c200cff40 0x7f1c20162000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c20070e50 tx=0x7f1c1802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf9fdf62d3fc84 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.278+0000 7f1c1effd640 1 -- 172.21.15.113:0/872787699 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1802c9f0 con 0x7f1c200cff40 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.278+0000 7f1c1effd640 1 -- 172.21.15.113:0/872787699 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1802cb90 con 0x7f1c200cff40 2024-02-26T12:19:29.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.278+0000 7f1c1effd640 1 -- 172.21.15.113:0/872787699 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c180343f0 con 0x7f1c200cff40 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 -- 172.21.15.113:0/872787699 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c200cff40 msgr2=0x7f1c20162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 --2- 172.21.15.113:0/872787699 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c200cff40 0x7f1c20162000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c20070e50 tx=0x7f1c1802be50 comp rx=0 tx=0).stop 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 -- 172.21.15.113:0/872787699 shutdown_connections 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 --2- 172.21.15.113:0/872787699 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c200cff40 0x7f1c20162000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 --2- 172.21.15.113:0/872787699 >> v2:172.21.15.152:3300/0 conn(0x7f1c2015de20 0x7f1c200cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 -- 172.21.15.113:0/872787699 >> 172.21.15.113:0/872787699 conn(0x7f1c20099a40 msgr2=0x7f1c200d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 -- 172.21.15.113:0/872787699 shutdown_connections 2024-02-26T12:19:29.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.279+0000 7f1c25b15640 1 -- 172.21.15.113:0/872787699 wait complete. 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 Processor -- start 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 -- start start 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c200cc900 0x7f1c200c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c200cff40 0x7f1c200c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cd5c0 con 0x7f1c2015de20 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cd2e0 con 0x7f1c200cff40 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.280+0000 7f1c25b15640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c200cd8a0 con 0x7f1c200cc900 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34214/0 (socket says 172.21.15.113:34214) 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 -- 172.21.15.113:0/3251683733 learned_addr learned my addr 172.21.15.113:0/3251683733 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c17fff640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c200cff40 0x7f1c200c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1f7fe640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c200cc900 0x7f1c200c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 -- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c200cc900 msgr2=0x7f1c200c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c200cc900 0x7f1c200c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 -- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c200cff40 msgr2=0x7f1c200c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c200cff40 0x7f1c200c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 -- 172.21.15.113:0/3251683733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200c48f0 con 0x7f1c2015de20 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1ffff640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009f40 tx=0x7f1c18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18043020 con 0x7f1c2015de20 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1803e450 con 0x7f1c2015de20 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c200c4bd0 con 0x7f1c2015de20 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1803e820 con 0x7f1c2015de20 2024-02-26T12:19:29.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.281+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c200c9ad0 con 0x7f1c2015de20 2024-02-26T12:19:29.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.282+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c200d0370 con 0x7f1c2015de20 2024-02-26T12:19:29.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.283+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c18046020 con 0x7f1c2015de20 2024-02-26T12:19:29.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.283+0000 7f1c1cff9640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 0x7f1c0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.283+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c180acae0 con 0x7f1c2015de20 2024-02-26T12:19:29.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.283+0000 7f1c1f7fe640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 0x7f1c0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.284+0000 7f1c1f7fe640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 0x7f1c0006d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c201f5750 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.287+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c200d0370 con 0x7f1c2015de20 2024-02-26T12:19:29.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.460+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c200ce780 con 0x7f1c2015de20 2024-02-26T12:19:29.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.460+0000 7f1c1cff9640 1 -- 172.21.15.113:0/3251683733 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c200ce780 con 0x7f1c2015de20 2024-02-26T12:19:29.446 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:29.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 msgr2=0x7f1c0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 0x7f1c0006d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c201f5750 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 msgr2=0x7f1c200c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009f40 tx=0x7f1c18004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 shutdown_connections 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c0006b4d0 0x7f1c0006d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c2015de20 0x7f1c200c6600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c200cff40 0x7f1c200c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 --2- 172.21.15.113:0/3251683733 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c200cc900 0x7f1c200c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 >> 172.21.15.113:0/3251683733 conn(0x7f1c20099a40 msgr2=0x7f1c200b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 shutdown_connections 2024-02-26T12:19:29.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.462+0000 7f1c25b15640 1 -- 172.21.15.113:0/3251683733 wait complete. 2024-02-26T12:19:29.459 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:29.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.572+0000 7fcd64568640 1 Processor -- start 2024-02-26T12:19:29.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.572+0000 7fcd64568640 1 -- start start 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd64568640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcd5c0b1c30 0x7fcd5c0b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd64568640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcd5c0b0df0 0x7fcd5c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd64568640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c06b800 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd64568640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0c4110 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd64568640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c06abf0 con 0x7fcd5c0b1c30 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62b05640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcd5c0b0df0 0x7fcd5c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62304640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcd5c15f1c0 0x7fcd5c0b1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33378/0 (socket says 172.21.15.113:33378) 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62304640 1 -- 172.21.15.113:0/1198870127 learned_addr learned my addr 172.21.15.113:0/1198870127 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd61b03640 1 --2- 172.21.15.113:0/1198870127 >> v2:172.21.15.152:3300/0 conn(0x7fcd5c0b1c30 0x7fcd5c0b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62b05640 1 -- 172.21.15.113:0/1198870127 >> v2:172.21.15.152:3300/0 conn(0x7fcd5c0b1c30 msgr2=0x7fcd5c0b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62b05640 1 --2- 172.21.15.113:0/1198870127 >> v2:172.21.15.152:3300/0 conn(0x7fcd5c0b1c30 0x7fcd5c0b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62b05640 1 -- 172.21.15.113:0/1198870127 >> v1:172.21.15.113:6789/0 conn(0x7fcd5c15f1c0 legacy=0x7fcd5c0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd62b05640 1 -- 172.21.15.113:0/1198870127 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c06aed0 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.573+0000 7fcd61302640 1 -- 172.21.15.113:0/1198870127 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396028916 0 0) 0x7fcd5c06b800 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd62b05640 1 --2- 172.21.15.113:0/1198870127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0b0df0 0x7fcd5c0cc780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009d90 tx=0x7fcd5402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0fff268231d8a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd61302640 1 -- 172.21.15.113:0/1198870127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54039070 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd61302640 1 -- 172.21.15.113:0/1198870127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5402cc60 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd61302640 1 -- 172.21.15.113:0/1198870127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54034660 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 -- 172.21.15.113:0/1198870127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0b0df0 msgr2=0x7fcd5c0cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 --2- 172.21.15.113:0/1198870127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0b0df0 0x7fcd5c0cc780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009d90 tx=0x7fcd5402beb0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 -- 172.21.15.113:0/1198870127 shutdown_connections 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 --2- 172.21.15.113:0/1198870127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c0b0df0 0x7fcd5c0cc780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 --2- 172.21.15.113:0/1198870127 >> v2:172.21.15.152:3300/0 conn(0x7fcd5c0b1c30 0x7fcd5c0b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.574+0000 7fcd64568640 1 -- 172.21.15.113:0/1198870127 >> 172.21.15.113:0/1198870127 conn(0x7fcd5c0d0760 msgr2=0x7fcd5c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.575+0000 7fcd64568640 1 -- 172.21.15.113:0/1198870127 shutdown_connections 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.575+0000 7fcd64568640 1 -- 172.21.15.113:0/1198870127 wait complete. 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 Processor -- start 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 -- start start 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcd5c0b0df0 0x7fcd5c1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 0x7fcd5c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0b1210 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c06b490 con 0x7fcd5c0b1c30 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd64568640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0cccc0 con 0x7fcd5c0b0df0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd62b05640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.576+0000 7fcd62b05640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34234/0 (socket says 172.21.15.113:34234) 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 -- 172.21.15.113:0/7217473 learned_addr learned my addr 172.21.15.113:0/7217473 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62304640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcd5c0b0df0 0x7fcd5c1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd61b03640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 0x7fcd5c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 -- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcd5c0b0df0 msgr2=0x7fcd5c1f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcd5c0b0df0 0x7fcd5c1f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 -- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 msgr2=0x7fcd5c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 0x7fcd5c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 -- 172.21.15.113:0/7217473 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c0c4430 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd61b03640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 0x7fcd5c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd62b05640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009d90 tx=0x7fcd54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54044020 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5403a040 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c0c4710 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54039050 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.577+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c0c4cd0 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.578+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c0afc90 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.579+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd54003bb0 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.579+0000 7fcd4effd640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.579+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd540ac740 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.579+0000 7fcd62304640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.579+0000 7fcd62304640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 0x7fcd4006d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd58000f60 tx=0x7fcd58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.583+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd5404e060 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.794+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5c0d0ce0 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.794+0000 7fcd4effd640 1 -- 172.21.15.113:0/7217473 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fcd5407b650 con 0x7fcd5c15f1c0 2024-02-26T12:19:29.781 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:29.781 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:29.781 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 msgr2=0x7fcd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 0x7fcd4006d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd58000f60 tx=0x7fcd58009040 comp rx=0 tx=0).stop 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 msgr2=0x7fcd5c0c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009d90 tx=0x7fcd54004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 shutdown_connections 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcd5c15f1c0 0x7fcd5c0c66a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcd5c0b1c30 0x7fcd5c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.783 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 --2- 172.21.15.113:0/7217473 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcd5c0b0df0 0x7fcd5c1f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 >> 172.21.15.113:0/7217473 conn(0x7fcd5c0d0760 msgr2=0x7fcd5c0c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 shutdown_connections 2024-02-26T12:19:29.784 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.796+0000 7fcd64568640 1 -- 172.21.15.113:0/7217473 wait complete. 2024-02-26T12:19:29.793 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:29.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.907+0000 7f8459a36640 1 Processor -- start 2024-02-26T12:19:29.894 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.907+0000 7f8459a36640 1 -- start start 2024-02-26T12:19:29.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415db00 0x7f84540cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f845415dee0 0x7f84540b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8454070c60 0x7f84540b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540711d0 con 0x7f845415dee0 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84540714b0 con 0x7f8454070c60 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8459a36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8454071790 con 0x7f845415db00 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f845415dee0 0x7f84540b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f845415dee0 0x7f84540b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34236/0 (socket says 172.21.15.113:34236) 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 -- 172.21.15.113:0/871080742 learned_addr learned my addr 172.21.15.113:0/871080742 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84537fe640 1 --2- 172.21.15.113:0/871080742 >> v2:172.21.15.152:3300/0 conn(0x7f8454070c60 0x7f84540b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f8452ffd640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415db00 0x7f84540cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 -- 172.21.15.113:0/871080742 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415db00 msgr2=0x7f84540cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415db00 0x7f84540cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 -- 172.21.15.113:0/871080742 >> v2:172.21.15.152:3300/0 conn(0x7f8454070c60 msgr2=0x7f84540b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:29.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 --2- 172.21.15.113:0/871080742 >> v2:172.21.15.152:3300/0 conn(0x7f8454070c60 0x7f84540b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.908+0000 7f84527fc640 1 -- 172.21.15.113:0/871080742 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454071a70 con 0x7f845415dee0 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.909+0000 7f84527fc640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415dee0 0x7f84540b3350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7878e092ae158d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.909+0000 7f8451ffb640 1 -- 172.21.15.113:0/871080742 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448035020 con 0x7f845415dee0 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.909+0000 7f8451ffb640 1 -- 172.21.15.113:0/871080742 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448031640 con 0x7f845415dee0 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.909+0000 7f8451ffb640 1 -- 172.21.15.113:0/871080742 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844802d040 con 0x7f845415dee0 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 -- 172.21.15.113:0/871080742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415dee0 msgr2=0x7f84540b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415dee0 0x7f84540b3350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8448009870 tx=0x7f844802b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 -- 172.21.15.113:0/871080742 shutdown_connections 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 --2- 172.21.15.113:0/871080742 >> v2:172.21.15.152:3300/0 conn(0x7f8454070c60 0x7f84540b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415dee0 0x7f84540b3350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 --2- 172.21.15.113:0/871080742 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415db00 0x7f84540cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 -- 172.21.15.113:0/871080742 >> 172.21.15.113:0/871080742 conn(0x7f84540ce350 msgr2=0x7f84540ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:29.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 -- 172.21.15.113:0/871080742 shutdown_connections 2024-02-26T12:19:29.899 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.910+0000 7f8459a36640 1 -- 172.21.15.113:0/871080742 wait complete. 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.911+0000 7f8459a36640 1 Processor -- start 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.911+0000 7f8459a36640 1 -- start start 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8454070c60 0x7f845414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415dee0 0x7f84540c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845406c150 con 0x7f845415db00 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540d03f0 con 0x7f8454070c60 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845406c2d0 con 0x7f845415dee0 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34240/0 (socket says 172.21.15.113:34240) 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 -- 172.21.15.113:0/345198099 learned_addr learned my addr 172.21.15.113:0/345198099 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:29.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84537fe640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415dee0 0x7f84540c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8452ffd640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8454070c60 0x7f845414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 -- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415dee0 msgr2=0x7f84540c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415dee0 0x7f84540c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 -- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8454070c60 msgr2=0x7f845414a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8454070c60 0x7f845414a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 -- 172.21.15.113:0/345198099 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845415fd00 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f84527fc640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8448000c00 tx=0x7f84480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448040070 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84480399f0 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845414b100 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448035040 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.912+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845414b6c0 con 0x7f845415db00 2024-02-26T12:19:29.903 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.914+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454074a50 con 0x7f845415db00 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.914+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f844804b060 con 0x7f845415db00 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.914+0000 7f843bfff640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 0x7f844006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.914+0000 7f8452ffd640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 0x7f844006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.914+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84480abb10 con 0x7f845415db00 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.915+0000 7f8452ffd640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 0x7f844006d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:29.904 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:29.919+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f844807a910 con 0x7f845415db00 2024-02-26T12:19:30.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.092+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84540cfde0 con 0x7f845415db00 2024-02-26T12:19:30.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.093+0000 7f843bfff640 1 -- 172.21.15.113:0/345198099 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f844807a210 con 0x7f845415db00 2024-02-26T12:19:30.080 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:30.080 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 msgr2=0x7f844006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 0x7f844006d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444008040 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 msgr2=0x7f845415f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8448000c00 tx=0x7f84480046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 shutdown_connections 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f844006b4d0 0x7f844006d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f845415dee0 0x7f84540c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f845415db00 0x7f845415f220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 --2- 172.21.15.113:0/345198099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8454070c60 0x7f845414a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 >> 172.21.15.113:0/345198099 conn(0x7f84540ce350 msgr2=0x7f845406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 shutdown_connections 2024-02-26T12:19:30.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.095+0000 7f8459a36640 1 -- 172.21.15.113:0/345198099 wait complete. 2024-02-26T12:19:30.093 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:30.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.205+0000 7fe78c71e640 1 Processor -- start 2024-02-26T12:19:30.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.205+0000 7fe78c71e640 1 -- start start 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.206+0000 7fe78c71e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7840b2d80 0x7fe7840d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.206+0000 7fe78c71e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe7840d3530 0x7fe7840ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.206+0000 7fe78c71e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840d1f50 con 0x7fe78415def0 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.206+0000 7fe78c71e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840d2230 con 0x7fe7840b2d80 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.206+0000 7fe78c71e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840d2510 con 0x7fe7840d3530 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7840b2d80 0x7fe7840d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe78a4ba640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe78415def0 0x7fe7840b9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33384/0 (socket says 172.21.15.113:33384) 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7840b2d80 0x7fe7840d2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34256/0 (socket says 172.21.15.113:34256) 2024-02-26T12:19:30.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe78a4ba640 1 -- 172.21.15.113:0/3703207453 learned_addr learned my addr 172.21.15.113:0/3703207453 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe78acbb640 1 --2- 172.21.15.113:0/3703207453 >> v2:172.21.15.152:3300/0 conn(0x7fe7840d3530 0x7fe7840ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 -- 172.21.15.113:0/3703207453 >> v2:172.21.15.152:3300/0 conn(0x7fe7840d3530 msgr2=0x7fe7840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 --2- 172.21.15.113:0/3703207453 >> v2:172.21.15.152:3300/0 conn(0x7fe7840d3530 0x7fe7840ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 -- 172.21.15.113:0/3703207453 >> v1:172.21.15.113:6789/0 conn(0x7fe78415def0 legacy=0x7fe7840b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe7894b8640 1 -- 172.21.15.113:0/3703207453 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903954481 0 0) 0x7fe7840d1f50 con 0x7fe78415def0 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.207+0000 7fe789cb9640 1 -- 172.21.15.113:0/3703207453 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840d27f0 con 0x7fe7840b2d80 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe789cb9640 1 --2- 172.21.15.113:0/3703207453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7840d2ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7740097a0 tx=0x7fe77402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c0057ef655528a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe7894b8640 1 -- 172.21.15.113:0/3703207453 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774035020 con 0x7fe7840b2d80 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe7894b8640 1 -- 172.21.15.113:0/3703207453 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774031830 con 0x7fe7840b2d80 2024-02-26T12:19:30.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe7894b8640 1 -- 172.21.15.113:0/3703207453 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774031c00 con 0x7fe7840b2d80 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 -- 172.21.15.113:0/3703207453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 msgr2=0x7fe7840d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 --2- 172.21.15.113:0/3703207453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7840d2ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7740097a0 tx=0x7fe77402b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 -- 172.21.15.113:0/3703207453 shutdown_connections 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 --2- 172.21.15.113:0/3703207453 >> v2:172.21.15.152:3300/0 conn(0x7fe7840d3530 0x7fe7840ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 --2- 172.21.15.113:0/3703207453 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7840d2ff0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 -- 172.21.15.113:0/3703207453 >> 172.21.15.113:0/3703207453 conn(0x7fe7840728b0 msgr2=0x7fe7840d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 -- 172.21.15.113:0/3703207453 shutdown_connections 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.208+0000 7fe78c71e640 1 -- 172.21.15.113:0/3703207453 wait complete. 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 Processor -- start 2024-02-26T12:19:30.199 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 -- start start 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7840d3530 0x7fe7840d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7840d4000 0x7fe7841f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cef70 con 0x7fe7840b2d80 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cedf0 con 0x7fe7840d3530 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78c71e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840cf0f0 con 0x7fe7840d4000 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78a4ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78a4ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34266/0 (socket says 172.21.15.113:34266) 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.210+0000 7fe78a4ba640 1 -- 172.21.15.113:0/1362086150 learned_addr learned my addr 172.21.15.113:0/1362086150 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 -- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7840d4000 msgr2=0x7fe7841f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7840d4000 0x7fe7841f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 -- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7840d3530 msgr2=0x7fe7840d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7840d3530 0x7fe7840d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 -- 172.21.15.113:0/1362086150 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7841f7970 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78a4ba640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c430 tx=0x7fe78000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800074e0 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7800047e0 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784154ea0 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780004bd0 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.211+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe784155460 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.212+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784074a50 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.212+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe780011070 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.213+0000 7fe77affd640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 0x7fe76806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.213+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe780089ed0 con 0x7fe7840b2d80 2024-02-26T12:19:30.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.213+0000 7fe789cb9640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 0x7fe76806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.202 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.213+0000 7fe789cb9640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 0x7fe76806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe774036000 tx=0x7fe774030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.217+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe780058d50 con 0x7fe7840b2d80 2024-02-26T12:19:30.410 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.424+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7840b5410 con 0x7fe7840b2d80 2024-02-26T12:19:30.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.425+0000 7fe77affd640 1 -- 172.21.15.113:0/1362086150 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fe780058650 con 0x7fe7840b2d80 2024-02-26T12:19:30.411 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:30.411 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:30.411 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:30.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 msgr2=0x7fe76806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 0x7fe76806d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe774036000 tx=0x7fe774030000 comp rx=0 tx=0).stop 2024-02-26T12:19:30.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 msgr2=0x7fe7841518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c430 tx=0x7fe78000c8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 shutdown_connections 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe76806b4d0 0x7fe76806d990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7840d4000 0x7fe7841f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7840d3530 0x7fe7840d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 --2- 172.21.15.113:0/1362086150 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7840b2d80 0x7fe7841518a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 >> 172.21.15.113:0/1362086150 conn(0x7fe7840728b0 msgr2=0x7fe7840d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 shutdown_connections 2024-02-26T12:19:30.414 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.427+0000 7fe78c71e640 1 -- 172.21.15.113:0/1362086150 wait complete. 2024-02-26T12:19:30.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-26T12:19:18.806139+0000', 'modified': '2024-02-26T12:19:21.785857+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6834/574691019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 574691019}, {'type': 'v1', 'addr': '172.21.15.152:6834', 'nonce': 574691019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-26T12:19:30.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-26T12:19:30.828 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-26T12:19:30.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.943+0000 7fce90088640 1 Processor -- start 2024-02-26T12:19:30.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 -- start start 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880d04e0 0x7fce880d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce880cedd0 0x7fce880d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce880b6db0 con 0x7fce8806c260 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880d0e00 con 0x7fce880cedd0 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce90088640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880d2e10 con 0x7fce880d04e0 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce8d623640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce880cedd0 0x7fce880d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.944+0000 7fce8d623640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce880cedd0 0x7fce880d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34278/0 (socket says 172.21.15.113:34278) 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 -- 172.21.15.113:0/1732478085 learned_addr learned my addr 172.21.15.113:0/1732478085 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8de24640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880d04e0 0x7fce880d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 -- 172.21.15.113:0/1732478085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880d04e0 msgr2=0x7fce880d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880d04e0 0x7fce880d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 -- 172.21.15.113:0/1732478085 >> v1:172.21.15.152:6789/0 conn(0x7fce8806c260 legacy=0x7fce8806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 -- 172.21.15.113:0/1732478085 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880d30f0 con 0x7fce880cedd0 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.945+0000 7fce8d623640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880cedd0 0x7fce880d08c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dabf4f2120f52e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce8ce22640 1 -- 172.21.15.113:0/1732478085 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84035020 con 0x7fce880cedd0 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce8ce22640 1 -- 172.21.15.113:0/1732478085 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce84031640 con 0x7fce880cedd0 2024-02-26T12:19:30.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce8ce22640 1 -- 172.21.15.113:0/1732478085 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8402d040 con 0x7fce880cedd0 2024-02-26T12:19:30.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 -- 172.21.15.113:0/1732478085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880cedd0 msgr2=0x7fce880d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880cedd0 0x7fce880d08c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce84009870 tx=0x7fce8402b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 -- 172.21.15.113:0/1732478085 shutdown_connections 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880cedd0 0x7fce880d08c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 --2- 172.21.15.113:0/1732478085 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880d04e0 0x7fce880d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 -- 172.21.15.113:0/1732478085 >> 172.21.15.113:0/1732478085 conn(0x7fce880728b0 msgr2=0x7fce880b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 -- 172.21.15.113:0/1732478085 shutdown_connections 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.946+0000 7fce90088640 1 -- 172.21.15.113:0/1732478085 wait complete. 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.947+0000 7fce90088640 1 Processor -- start 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.947+0000 7fce90088640 1 -- start start 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce8806c260 0x7fce88152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880cedd0 0x7fce880c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8815e050 con 0x7fce880d04e0 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880d36b0 con 0x7fce8806c260 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce90088640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cf230 con 0x7fce880cedd0 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34288/0 (socket says 172.21.15.113:34288) 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 -- 172.21.15.113:0/3787804604 learned_addr learned my addr 172.21.15.113:0/3787804604 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8d623640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880cedd0 0x7fce880c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8de24640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce8806c260 0x7fce88152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 -- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880cedd0 msgr2=0x7fce880c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880cedd0 0x7fce880c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 -- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce8806c260 msgr2=0x7fce88152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce8806c260 0x7fce88152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.948+0000 7fce8e625640 1 -- 172.21.15.113:0/3787804604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce88156fe0 con 0x7fce880d04e0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce8e625640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c6e0 tx=0x7fce8000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce7e7fc640 1 -- 172.21.15.113:0/3787804604 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80003b70 con 0x7fce880d04e0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce7e7fc640 1 -- 172.21.15.113:0/3787804604 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80003d30 con 0x7fce880d04e0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce881572c0 con 0x7fce880d04e0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce7e7fc640 1 -- 172.21.15.113:0/3787804604 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80005310 con 0x7fce880d04e0 2024-02-26T12:19:30.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.949+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce880cb500 con 0x7fce880d04e0 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.950+0000 7fce7e7fc640 1 -- 172.21.15.113:0/3787804604 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce800054b0 con 0x7fce880d04e0 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.951+0000 7fce7e7fc640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.951+0000 7fce7e7fc640 1 -- 172.21.15.113:0/3787804604 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce80089fb0 con 0x7fce880d04e0 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.951+0000 7fce8de24640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.951+0000 7fce8de24640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 0x7fce6c06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 Processor -- start 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 -- start start 2024-02-26T12:19:30.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd35840 0x56396cd35c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd39890 0x56396cd3b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cc9f680 con 0x56396cd655d0 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cc48a30 con 0x56396cd39890 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x56396cc9b720 con 0x56396cd35840 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34304/0 (socket says 172.21.15.113:34304) 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.952+0000 7fce8e625640 1 -- 172.21.15.113:0/1501955408 learned_addr learned my addr 172.21.15.113:0/1501955408 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8d623640 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd39890 0x56396cd3b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8de24640 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd35840 0x56396cd35c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 -- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd35840 msgr2=0x56396cd35c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd35840 0x56396cd35c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 -- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd39890 msgr2=0x56396cd3b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd39890 0x56396cd3b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 -- 172.21.15.113:0/1501955408 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56396cc66f00 con 0x56396cd655d0 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce8e625640 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce800884e0 tx=0x7fce80011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6329143eaf68153 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce6b7fe640 1 -- 172.21.15.113:0/1501955408 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80086070 con 0x56396cd655d0 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce6b7fe640 1 -- 172.21.15.113:0/1501955408 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80060ed0 con 0x56396cd655d0 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.953+0000 7fce6b7fe640 1 -- 172.21.15.113:0/1501955408 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80070070 con 0x56396cd655d0 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- 172.21.15.113:0/1501955408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 msgr2=0x56396cd65a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fce800884e0 tx=0x7fce80011000 comp rx=0 tx=0).stop 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- 172.21.15.113:0/1501955408 shutdown_connections 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd655d0 0x56396cd65a50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd39890 0x56396cd3b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 --2- 172.21.15.113:0/1501955408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd35840 0x56396cd35c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- 172.21.15.113:0/1501955408 >> 172.21.15.113:0/1501955408 conn(0x56396cd378c0 msgr2=0x56396cd39180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- 172.21.15.113:0/1501955408 shutdown_connections 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- 172.21.15.113:0/1501955408 wait complete. 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 -- start start 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.954+0000 7fce92e61740 1 Processor -- start 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd80e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cd39d20 con 0x56396cd5c460 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cc5be70 con 0x56396cd655d0 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x56396cd3a000 con 0x56396cd7e210 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce92e61740 10 client.0 _ll_register_callbacks cb 0x56396cc5b840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34310/0 (socket says 172.21.15.113:34310) 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce8e625640 1 -- 172.21.15.113:0/1492877660 learned_addr learned my addr 172.21.15.113:0/1492877660 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce8d623640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.955+0000 7fce8de24640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd80e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 -- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 msgr2=0x56396cd831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 -- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 msgr2=0x56396cd80e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd80e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 -- 172.21.15.113:0/1492877660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56396cc5c240 con 0x56396cd5c460 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8e625640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce800885c0 tx=0x7fce80001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534cc675ddc11c27 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80075060 con 0x56396cd5c460 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce800701e0 con 0x56396cd5c460 2024-02-26T12:19:30.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce80060ed0 con 0x56396cd5c460 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce80086070 con 0x56396cd5c460 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 10 client.4596 fetch_fsmap learned FSMap version 7 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56396c9b42d0 con 0x56396cd5c460 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80060ed0 con 0x56396cd5c460 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce80054e30 con 0x56396cd5c460 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 10 client.4596 fetch_fsmap finished waiting for FSMap version 7 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 10 client.4596 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 20 client.4596 populate_metadata read hostname 'smithi113' 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd5ac60 0x56396cd9f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 4 client.4596 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 --> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56396ccacbc0 con 0x56396cd5ac60 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.956+0000 7fce8de24640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd5ac60 0x56396cd9f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.957+0000 7fce68ff9640 10 client.4596 ms_handle_connect on v2:172.21.15.152:6832/574691019 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.957+0000 7fce8de24640 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd5ac60 0x56396cd9f330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa645e4dbd48ff86 server_cookie=dfb05e47693d4d1b in_seq=0 out_seq=0 2024-02-26T12:19:30.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce68ff9640 1 -- 172.21.15.113:0/1492877660 <== mds.0 v2:172.21.15.152:6832/574691019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56396ccacbc0 con 0x56396cd5ac60 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce68ff9640 10 client.4596 handle_command_reply: tid=0 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 client.4596 shutdown 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 msgr2=0x56396cd83700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce800885c0 tx=0x7fce80001250 comp rx=0 tx=0).stop 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 shutdown_connections 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd5ac60 0x56396cd9f330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cd83700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 --2- 172.21.15.113:0/1492877660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd80e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 >> 172.21.15.113:0/1492877660 conn(0x56396cd35840 msgr2=0x56396cd344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce68ff9640 0 client.4596 ms_handle_reset on v2:172.21.15.152:6832/574691019 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 shutdown_connections 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 1 -- 172.21.15.113:0/1492877660 wait complete. 2024-02-26T12:19:30.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.958+0000 7fce92e61740 20 client.4596 trim_cache size 0 max 16384 2024-02-26T12:19:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.973+0000 7fce92e61740 1 Processor -- start 2024-02-26T12:19:30.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 -- start start 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd5c460 0x56396cd344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd655d0 0x56396cd34a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881ff460 con 0x56396cd7e210 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881fe970 con 0x56396cd5c460 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce881fee90 con 0x56396cd655d0 2024-02-26T12:19:30.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34312/0 (socket says 172.21.15.113:34312) 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 -- 172.21.15.113:0/3229902727 learned_addr learned my addr 172.21.15.113:0/3229902727 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 -- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd655d0 msgr2=0x56396cd34a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd655d0 0x56396cd34a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 -- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd5c460 msgr2=0x56396cd344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd5c460 0x56396cd344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.974+0000 7fce8e625640 1 -- 172.21.15.113:0/3229902727 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56396ca7e6b0 con 0x56396cd7e210 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce8e625640 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce80077440 tx=0x7fce80082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0bc64177dc897b server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce6affd640 1 -- 172.21.15.113:0/3229902727 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80070040 con 0x56396cd7e210 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce6affd640 1 -- 172.21.15.113:0/3229902727 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80088050 con 0x56396cd7e210 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce6affd640 1 -- 172.21.15.113:0/3229902727 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80060ed0 con 0x56396cd7e210 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 -- 172.21.15.113:0/3229902727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 msgr2=0x56396cd8f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce80077440 tx=0x7fce80082000 comp rx=0 tx=0).stop 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 -- 172.21.15.113:0/3229902727 shutdown_connections 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd7e210 0x56396cd8f020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd655d0 0x56396cd34a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 --2- 172.21.15.113:0/3229902727 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd5c460 0x56396cd344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 -- 172.21.15.113:0/3229902727 >> 172.21.15.113:0/3229902727 conn(0x56396cd35840 msgr2=0x56396cd3bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 -- 172.21.15.113:0/3229902727 shutdown_connections 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.975+0000 7fce92e61740 1 -- 172.21.15.113:0/3229902727 wait complete. 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.976+0000 7fce92e61740 1 -- start start 2024-02-26T12:19:30.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.976+0000 7fce92e61740 1 Processor -- start 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd8f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd92bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cd39d20 con 0x56396cd5c460 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56396cd3a000 con 0x56396cd655d0 2024-02-26T12:19:30.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x56396cc5be70 con 0x56396cd7e210 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 10 client.0 _ll_register_callbacks cb 0x7fce80084070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34324/0 (socket says 172.21.15.113:34324) 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 -- 172.21.15.113:0/1344727597 learned_addr learned my addr 172.21.15.113:0/1344727597 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8d623640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8e625640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd92bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 -- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 msgr2=0x56396cd92bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd92bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 -- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 msgr2=0x56396cd8f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd8f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 -- 172.21.15.113:0/1344727597 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56396cd34b80 con 0x56396cd5c460 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8d623640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd8f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8e625640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd92bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:30.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce8de24640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce7800f890 tx=0x7fce78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5852985fcc1504d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7801b030 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce78014df0 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.977+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce80088050 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce78037050 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 10 client.4602 fetch_fsmap learned FSMap version 7 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56396cd649e0 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80088050 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce7803a020 con 0x56396cd5c460 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 10 client.4602 fetch_fsmap finished waiting for FSMap version 7 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 10 client.4602 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 20 client.4602 populate_metadata read hostname 'smithi113' 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd7ebf0 0x56396cde0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:30.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 4 client.4602 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 --> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56396cd7fdf0 con 0x56396cd7ebf0 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce8d623640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd7ebf0 0x56396cde0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce68ff9640 10 client.4602 ms_handle_connect on v2:172.21.15.152:6832/574691019 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.978+0000 7fce8d623640 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd7ebf0 0x56396cde0910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=253aeb53e9746a1f server_cookie=1d9017c947d35cb9 in_seq=0 out_seq=0 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce68ff9640 1 -- 172.21.15.113:0/1344727597 <== mds.0 v2:172.21.15.152:6832/574691019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56396cd7fdf0 con 0x56396cd7ebf0 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce68ff9640 10 client.4602 handle_command_reply: tid=0 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 client.4602 shutdown 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 msgr2=0x56396cda0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce7800f890 tx=0x7fce78004730 comp rx=0 tx=0).stop 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 shutdown_connections 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:6832/574691019,v1:172.21.15.152:6834/574691019] conn(0x56396cd7ebf0 0x56396cde0910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56396cd7e210 0x56396cd92bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56396cd655d0 0x56396cd8f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 --2- 172.21.15.113:0/1344727597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x56396cd5c460 0x56396cda0dd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce68ff9640 0 client.4602 ms_handle_reset on v2:172.21.15.152:6832/574691019 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 >> 172.21.15.113:0/1344727597 conn(0x56396cd35840 msgr2=0x56396cd39050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 shutdown_connections 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 1 -- 172.21.15.113:0/1344727597 wait complete. 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce92e61740 20 client.4602 trim_cache size 0 max 16384 2024-02-26T12:19:30.972 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "74a57275-9dde-4d5b-99d3-80ee62f4964a", 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4306, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 11.520656454999999, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 7, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 20, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 20, 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 18.290522016000001 2024-02-26T12:19:30.973 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:19:30.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 msgr2=0x7fce6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 0x7fce6c06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce78006fd0 tx=0x7fce78008040 comp rx=0 tx=0).stop 2024-02-26T12:19:30.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 msgr2=0x7fce880c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:30.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c6e0 tx=0x7fce8000cba0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.974 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 shutdown_connections 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce880d04e0 0x7fce880c8ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce880cedd0 0x7fce880c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 --2- 172.21.15.113:0/3787804604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce8806c260 0x7fce88152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 >> 172.21.15.113:0/3787804604 conn(0x7fce880728b0 msgr2=0x7fce8815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 shutdown_connections 2024-02-26T12:19:30.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:30.979+0000 7fce90088640 1 -- 172.21.15.113:0/3787804604 wait complete. 2024-02-26T12:19:30.976 INFO:teuthology.run_tasks:Running task kclient... 2024-02-26T12:19:31.002 INFO:tasks.kclient:Mounting kernel clients... 2024-02-26T12:19:31.002 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-02-26T12:19:31.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.003 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:19:31.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.018 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-02-26T12:19:31.086 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2024-02-26T12:19:31.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:19:31.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.088 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:19:31.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.143 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-02-26T12:19:31.210 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2024-02-26T12:19:31.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:19:31.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.212 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:19:31.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-02-26T12:19:31.304 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-02-26T12:19:31.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:19:31.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.306 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:19:31.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-02-26T12:19:31.440 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-02-26T12:19:31.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:19:31.441 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-02-26T12:19:31.442 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-26T12:19:31.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-26T12:19:31.442 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-26T12:19:31.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.558+0000 7fa1471cc640 1 Processor -- start 2024-02-26T12:19:31.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.558+0000 7fa1471cc640 1 -- start start 2024-02-26T12:19:31.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa1471cc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1400ce8b0 0x7fa1400ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:31.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa1471cc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400d1f50 con 0x7fa14015def0 2024-02-26T12:19:31.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa1471cc640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400d2230 con 0x7fa1400b2d80 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa1471cc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1400cf240 con 0x7fa1400ce8b0 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa145769640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1400ce8b0 0x7fa1400ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa144f68640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa14015def0 0x7fa1400b9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:33394/0 (socket says 172.21.15.113:33394) 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa144f68640 1 -- 172.21.15.113:0/846254021 learned_addr learned my addr 172.21.15.113:0/846254021 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa145769640 1 -- 172.21.15.113:0/846254021 >> v1:172.21.15.152:6789/0 conn(0x7fa1400b2d80 legacy=0x7fa1400d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa145769640 1 -- 172.21.15.113:0/846254021 >> v1:172.21.15.113:6789/0 conn(0x7fa14015def0 legacy=0x7fa1400b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa13f7fe640 1 -- 172.21.15.113:0/846254021 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899508413 0 0) 0x7fa1400d1f50 con 0x7fa14015def0 2024-02-26T12:19:31.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.559+0000 7fa145769640 1 -- 172.21.15.113:0/846254021 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400d2510 con 0x7fa1400ce8b0 2024-02-26T12:19:31.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa145769640 1 --2- 172.21.15.113:0/846254021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1400ce8b0 0x7fa1400ced00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa138009dc0 tx=0x7fa13802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8c3256bc4c35e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa13f7fe640 1 -- 172.21.15.113:0/846254021 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138039070 con 0x7fa1400ce8b0 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa13f7fe640 1 -- 172.21.15.113:0/846254021 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13802cc40 con 0x7fa1400ce8b0 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa13f7fe640 1 -- 172.21.15.113:0/846254021 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138034440 con 0x7fa1400ce8b0 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa1471cc640 1 -- 172.21.15.113:0/846254021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1400ce8b0 msgr2=0x7fa1400ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.560+0000 7fa1471cc640 1 --2- 172.21.15.113:0/846254021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1400ce8b0 0x7fa1400ced00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa138009dc0 tx=0x7fa13802be90 comp rx=0 tx=0).stop 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.561+0000 7fa1471cc640 1 -- 172.21.15.113:0/846254021 shutdown_connections 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.561+0000 7fa1471cc640 1 --2- 172.21.15.113:0/846254021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1400ce8b0 0x7fa1400ced00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.561+0000 7fa1471cc640 1 -- 172.21.15.113:0/846254021 >> 172.21.15.113:0/846254021 conn(0x7fa1400728b0 msgr2=0x7fa1400d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.561+0000 7fa1471cc640 1 -- 172.21.15.113:0/846254021 shutdown_connections 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.561+0000 7fa1471cc640 1 -- 172.21.15.113:0/846254021 wait complete. 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.562+0000 7fa1471cc640 1 Processor -- start 2024-02-26T12:19:31.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.562+0000 7fa1471cc640 1 -- start start 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.562+0000 7fa1471cc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 0x7fa1401f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.562+0000 7fa1471cc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1400ce8b0 0x7fa1401f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.562+0000 7fa1471cc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa1471cc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400d3700 con 0x7fa14015f380 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa1471cc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400d2ad0 con 0x7fa1400ce8b0 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa1471cc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400b6c10 con 0x7fa1400b2d80 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34346/0 (socket says 172.21.15.113:34346) 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 -- 172.21.15.113:0/4144066743 learned_addr learned my addr 172.21.15.113:0/4144066743 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:31.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa13ffff640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1400ce8b0 0x7fa1401f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa144f68640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 0x7fa1401f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 -- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 msgr2=0x7fa1401f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 0x7fa1401f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 -- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1400ce8b0 msgr2=0x7fa1401f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1400ce8b0 0x7fa1401f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 -- 172.21.15.113:0/4144066743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14015e2e0 con 0x7fa14015f380 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa144f68640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 0x7fa1401f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa145769640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa13802c4a0 tx=0x7fa138004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138044020 con 0x7fa14015f380 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138034e30 con 0x7fa14015f380 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138039040 con 0x7fa14015f380 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14015e5c0 con 0x7fa14015f380 2024-02-26T12:19:31.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.563+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14015eb80 con 0x7fa14015f380 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.564+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa140074a50 con 0x7fa14015f380 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.565+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa138047020 con 0x7fa14015f380 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.565+0000 7fa13d7fa640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 0x7fa12406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.565+0000 7fa144f68640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 0x7fa12406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.565+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1380acec0 con 0x7fa14015f380 2024-02-26T12:19:31.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.565+0000 7fa144f68640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 0x7fa12406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa134000f60 tx=0x7fa134009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:31.555 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.569+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa13804e020 con 0x7fa14015f380 2024-02-26T12:19:31.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.778+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1400d19d0 con 0x7fa14015f380 2024-02-26T12:19:31.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.778+0000 7fa13d7fa640 1 -- 172.21.15.113:0/4144066743 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa13807be00 con 0x7fa14015f380 2024-02-26T12:19:31.765 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-26T12:19:31.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 msgr2=0x7fa12406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 0x7fa12406d9c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa134000f60 tx=0x7fa134009040 comp rx=0 tx=0).stop 2024-02-26T12:19:31.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 msgr2=0x7fa14015f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:31.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa13802c4a0 tx=0x7fa138004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:31.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 shutdown_connections 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa12406b500 0x7fa12406d9c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa14015f380 0x7fa14015f810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1400ce8b0 0x7fa1401f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 --2- 172.21.15.113:0/4144066743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1400b2d80 0x7fa1401f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 >> 172.21.15.113:0/4144066743 conn(0x7fa1400728b0 msgr2=0x7fa1400b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 shutdown_connections 2024-02-26T12:19:31.767 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:31.780+0000 7fa1471cc640 1 -- 172.21.15.113:0/4144066743 wait complete. 2024-02-26T12:19:31.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-26T12:19:31.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-26T12:19:31.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-26T12:19:31.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-26T12:19:31.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.778 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:31.794 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2024-02-26T12:19:31.795 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:31.795 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-26T12:19:31.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add name ceph-brx type bridge 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr flush dev ceph-brx 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set ceph-brx up 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-26T12:19:31.796 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:31.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:31.976 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-26T12:19:32.003 INFO:teuthology.orchestra.run.smithi113.stdout:1 2024-02-26T12:19:32.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.004 DEBUG:teuthology.orchestra.run.smithi113:> route 2024-02-26T12:19:32.076 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2024-02-26T12:19:32.076 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-26T12:19:32.076 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-26T12:19:32.076 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-26T12:19:32.076 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-26T12:19:32.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-26T12:19:32.077 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:32.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.329 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:19:32.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.345 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2024-02-26T12:19:32.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.400 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:32.400 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:32.400 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-26T12:19:32.400 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-26T12:19:32.400 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:32.483 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-26T12:19:32.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-26T12:19:32.483 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:32.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.623 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:32.623 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:32.623 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2024-02-26T12:19:32.623 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.0 master ceph-brx 2024-02-26T12:19:32.623 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:32.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:32.665 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-26T12:19:32.721 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-26T12:19:32.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:32.721 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-26T12:19:32.775 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-26T12:19:32.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.776 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:32.868 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:32.868 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:32.977 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:32.977 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.152:3300,172.21.15.152:3301" 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@74a57275-9dde-4d5b-99d3-80ee62f4964a.cephfs=/ 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.152:3300/172.21.15.152:3301" will pass to kernel 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2024-02-26T12:19:32.978 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-26T12:19:32.979 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2024-02-26T12:19:32.979 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-26T12:19:32.980 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-26T12:19:32.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:32.980 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-26T12:19:33.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.007 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:33.069 INFO:teuthology.orchestra.run.smithi113.stdout:client4439 2024-02-26T12:19:33.069 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:33.069 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:33.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.125 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:33.185 INFO:teuthology.orchestra.run.smithi113.stdout:client4439 2024-02-26T12:19:33.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.186 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:33.247 INFO:teuthology.orchestra.run.smithi113.stdout:client4439 2024-02-26T12:19:33.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.248 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/74a57275-9dde-4d5b-99d3-80ee62f4964a.client4439/status') 2024-02-26T12:19:33.318 INFO:teuthology.orchestra.run.smithi113.stdout:instance: client.4439 (3)172.21.15.113:0/3089206717 2024-02-26T12:19:33.318 INFO:teuthology.orchestra.run.smithi113.stdout:blocklisted: false 2024-02-26T12:19:33.318 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records in 2024-02-26T12:19:33.318 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records out 2024-02-26T12:19:33.318 INFO:teuthology.orchestra.run.smithi113.stderr:71 bytes copied, 2.8502e-05 s, 2.5 MB/s 2024-02-26T12:19:33.319 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-02-26T12:19:33.319 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-26T12:19:33.320 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-26T12:19:33.320 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-26T12:19:33.460 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.475+0000 7f797fca6640 1 Processor -- start 2024-02-26T12:19:33.461 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.475+0000 7f797fca6640 1 -- start start 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f797815bb50 0x7f79780716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79780d0d00 0x7f79780cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79780b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7978070c60 con 0x7f79780d0d00 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7978071bf0 con 0x7f797815bb50 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797fca6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780cc5f0 con 0x7f79780b3350 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797d241640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79780d0d00 0x7f79780cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797d241640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79780d0d00 0x7f79780cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34354/0 (socket says 172.21.15.113:34354) 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.476+0000 7f797d241640 1 -- 172.21.15.113:0/2585205511 learned_addr learned my addr 172.21.15.113:0/2585205511 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:33.462 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 -- 172.21.15.113:0/2585205511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 msgr2=0x7f79780b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797da42640 1 --2- 172.21.15.113:0/2585205511 >> v2:172.21.15.152:3300/0 conn(0x7f797815bb50 0x7f79780716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797e243640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79780b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79780b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 -- 172.21.15.113:0/2585205511 >> v2:172.21.15.152:3300/0 conn(0x7f797815bb50 msgr2=0x7f79780716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 --2- 172.21.15.113:0/2585205511 >> v2:172.21.15.152:3300/0 conn(0x7f797815bb50 0x7f79780716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 -- 172.21.15.113:0/2585205511 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780cc8a0 con 0x7f79780d0d00 2024-02-26T12:19:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797d241640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79780d0d00 0x7f79780cc0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79780b4480 tx=0x7f796802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8307e273e92ae1d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797ca40640 1 -- 172.21.15.113:0/2585205511 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802e070 con 0x7f79780d0d00 2024-02-26T12:19:33.464 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.477+0000 7f797ca40640 1 -- 172.21.15.113:0/2585205511 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7968037070 con 0x7f79780d0d00 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797ca40640 1 -- 172.21.15.113:0/2585205511 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968031a00 con 0x7f79780d0d00 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 -- 172.21.15.113:0/2585205511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79780d0d00 msgr2=0x7f79780cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79780d0d00 0x7f79780cc0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79780b4480 tx=0x7f796802b880 comp rx=0 tx=0).stop 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 -- 172.21.15.113:0/2585205511 shutdown_connections 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79780b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 --2- 172.21.15.113:0/2585205511 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79780d0d00 0x7f79780cc0b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 --2- 172.21.15.113:0/2585205511 >> v2:172.21.15.152:3300/0 conn(0x7f797815bb50 0x7f79780716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 -- 172.21.15.113:0/2585205511 >> 172.21.15.113:0/2585205511 conn(0x7f79780ce350 msgr2=0x7f79780ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 -- 172.21.15.113:0/2585205511 shutdown_connections 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.478+0000 7f797fca6640 1 -- 172.21.15.113:0/2585205511 wait complete. 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.479+0000 7f797fca6640 1 Processor -- start 2024-02-26T12:19:33.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.479+0000 7f797fca6640 1 -- start start 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79781f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 0x7f7978150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978071190 con 0x7f797815bb50 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7978070eb0 con 0x7f79780d0d00 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797fca6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797815bf30 con 0x7f79780b3350 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34356/0 (socket says 172.21.15.113:34356) 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 -- 172.21.15.113:0/3892774859 learned_addr learned my addr 172.21.15.113:0/3892774859 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:33.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797d241640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 0x7f7978150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797da42640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79781f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 -- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 msgr2=0x7f79781f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79781f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.480+0000 7f797e243640 1 -- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 msgr2=0x7f7978150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797e243640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 0x7f7978150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797e243640 1 -- 172.21.15.113:0/3892774859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780c99f0 con 0x7f797815bb50 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797d241640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 0x7f7978150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797e243640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f797000cc60 tx=0x7f797000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970003990 con 0x7f797815bb50 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970003b30 con 0x7f797815bb50 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970004020 con 0x7f797815bb50 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79780c9cb0 con 0x7f797815bb50 2024-02-26T12:19:33.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.481+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79780ca270 con 0x7f797815bb50 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.482+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7978074a50 con 0x7f797815bb50 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.482+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79700041c0 con 0x7f797815bb50 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.483+0000 7f796e7fc640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 0x7f795c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.483+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f797008a690 con 0x7f797815bb50 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.483+0000 7f797da42640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 0x7f795c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:33.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.483+0000 7f797da42640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 0x7f795c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f797400b7e0 tx=0x7f7974008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:33.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.487+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7970014030 con 0x7f797815bb50 2024-02-26T12:19:33.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.692+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79780cf240 con 0x7f797815bb50 2024-02-26T12:19:33.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.692+0000 7f796e7fc640 1 -- 172.21.15.113:0/3892774859 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7970059510 con 0x7f797815bb50 2024-02-26T12:19:33.677 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-26T12:19:33.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 msgr2=0x7f795c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:33.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 0x7f795c06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f797400b7e0 tx=0x7f7974008040 comp rx=0 tx=0).stop 2024-02-26T12:19:33.679 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 msgr2=0x7f797815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f797000cc60 tx=0x7f797000a5c0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 shutdown_connections 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f795c06b4d0 0x7f795c06d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f797815bb50 0x7f797815df90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79780d0d00 0x7f7978150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 --2- 172.21.15.113:0/3892774859 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79780b3350 0x7f79781f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 >> 172.21.15.113:0/3892774859 conn(0x7f79780ce350 msgr2=0x7f79780b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 shutdown_connections 2024-02-26T12:19:33.680 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:33.694+0000 7f797fca6640 1 -- 172.21.15.113:0/3892774859 wait complete. 2024-02-26T12:19:33.689 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-26T12:19:33.690 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-02-26T12:19:33.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.690 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2024-02-26T12:19:33.705 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:33.705 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:33.705 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:33.705 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.705 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42713sec preferred_lft 42713sec 2024-02-26T12:19:33.706 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 7e:97:82:08:1b:8b brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec34:f7ff:fe5e:37dd/64 scope link 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 7e:97:82:08:1b:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::7c97:82ff:fe08:1b8b/64 scope link tentative 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:33.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.708 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-26T12:19:33.772 INFO:teuthology.orchestra.run.smithi113.stdout:1 2024-02-26T12:19:33.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.773 DEBUG:teuthology.orchestra.run.smithi113:> route 2024-02-26T12:19:33.828 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2024-02-26T12:19:33.828 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-26T12:19:33.828 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-26T12:19:33.829 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-26T12:19:33.829 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-26T12:19:33.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-26T12:19:33.829 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:33.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.923 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:19:33.938 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-26T12:19:33.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.938 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2024-02-26T12:19:33.993 INFO:teuthology.orchestra.run.smithi113.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-02-26T12:19:33.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-26T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-02-26T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:34.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.075 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-26T12:19:34.141 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 56:c0:f9:28:27:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-26T12:19:34.142 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-26T12:19:34.143 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.143 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::54c0:f9ff:fe28:2784/64 scope link tentative 2024-02-26T12:19:34.143 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.144 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-02-26T12:19:34.211 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:34.211 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:34.211 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:34.212 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.212 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:34.212 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.212 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:34.212 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 56:c0:f9:28:27:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-26T12:19:34.213 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-26T12:19:34.213 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.213 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::54c0:f9ff:fe28:2784/64 scope link tentative 2024-02-26T12:19:34.213 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:34.215 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-02-26T12:19:34.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-02-26T12:19:34.216 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-02-26T12:19:34.217 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:34.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.340 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:19:34.340 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:19:34.341 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.1 up 2024-02-26T12:19:34.341 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.1 master ceph-brx 2024-02-26T12:19:34.341 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:19:34.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:34.383 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-02-26T12:19:34.438 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-02-26T12:19:34.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:34.438 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-02-26T12:19:34.492 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-02-26T12:19:34.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.493 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:34.577 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:34.578 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:34.585 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:34.585 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:34.585 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.152:3300,172.21.15.152:3301" 2024-02-26T12:19:34.585 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 2@74a57275-9dde-4d5b-99d3-80ee62f4964a.cephfs=/ 2024-02-26T12:19:34.585 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.113:3300/172.21.15.152:3300/172.21.15.152:3301" will pass to kernel 2024-02-26T12:19:34.586 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-02-26T12:19:34.586 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2024-02-26T12:19:34.586 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-26T12:19:34.586 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2024-02-26T12:19:34.586 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-26T12:19:34.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-26T12:19:34.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.588 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-02-26T12:19:34.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.656 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:34.713 INFO:teuthology.orchestra.run.smithi113.stdout:client4620 2024-02-26T12:19:34.713 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:34.713 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:34.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.768 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:34.826 INFO:teuthology.orchestra.run.smithi113.stdout:client4620 2024-02-26T12:19:34.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.826 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:34.882 INFO:teuthology.orchestra.run.smithi113.stdout:client4620 2024-02-26T12:19:34.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:34.882 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/74a57275-9dde-4d5b-99d3-80ee62f4964a.client4620/status') 2024-02-26T12:19:34.948 INFO:teuthology.orchestra.run.smithi113.stdout:instance: client.4620 (3)192.168.0.2:0/3601750394 2024-02-26T12:19:34.949 INFO:teuthology.orchestra.run.smithi113.stdout:blocklisted: false 2024-02-26T12:19:34.949 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records in 2024-02-26T12:19:34.949 INFO:teuthology.orchestra.run.smithi113.stderr:0+1 records out 2024-02-26T12:19:34.949 INFO:teuthology.orchestra.run.smithi113.stderr:69 bytes copied, 2.1772e-05 s, 3.2 MB/s 2024-02-26T12:19:34.950 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-02-26T12:19:34.950 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-26T12:19:34.950 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-26T12:19:34.950 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-26T12:19:35.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.104+0000 7fa6d491e640 1 Processor -- start 2024-02-26T12:19:35.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.104+0000 7fa6d491e640 1 -- start start 2024-02-26T12:19:35.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6d006fd80 0x7fa6d006ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa6d0070160 0x7fa6d006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d006df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d006b7a0 con 0x7fa6d0070160 2024-02-26T12:19:35.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d006ba80 con 0x7fa6d006fd80 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6d491e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d006bd60 con 0x7fa6d006dad0 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa6d0070160 0x7fa6d006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa6d0070160 0x7fa6d006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34372/0 (socket says 172.21.15.113:34372) 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1446153282 learned_addr learned my addr 172.21.15.113:0/1446153282 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6ce59c640 1 --2- 172.21.15.113:0/1446153282 >> v2:172.21.15.152:3300/0 conn(0x7fa6d006fd80 0x7fa6d006ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6ced9d640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1446153282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 msgr2=0x7fa6d006df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d006df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1446153282 >> v2:172.21.15.152:3300/0 conn(0x7fa6d006fd80 msgr2=0x7fa6d006ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1446153282 >> v2:172.21.15.152:3300/0 conn(0x7fa6d006fd80 0x7fa6d006ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.105+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1446153282 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d006c040 con 0x7fa6d0070160 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d0070160 0x7fa6d006b090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0072f70 tx=0x7fa6b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968d6b25e2b7d0f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:35.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6cdd9b640 1 -- 172.21.15.113:0/1446153282 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b802e070 con 0x7fa6d0070160 2024-02-26T12:19:35.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6cdd9b640 1 -- 172.21.15.113:0/1446153282 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b8037070 con 0x7fa6d0070160 2024-02-26T12:19:35.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6cdd9b640 1 -- 172.21.15.113:0/1446153282 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8031a00 con 0x7fa6d0070160 2024-02-26T12:19:35.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6d491e640 1 -- 172.21.15.113:0/1446153282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d0070160 msgr2=0x7fa6d006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.106+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d0070160 0x7fa6d006b090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0072f70 tx=0x7fa6b802b880 comp rx=0 tx=0).stop 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 -- 172.21.15.113:0/1446153282 shutdown_connections 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d006df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1446153282 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d0070160 0x7fa6d006b090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1446153282 >> v2:172.21.15.152:3300/0 conn(0x7fa6d006fd80 0x7fa6d006ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 -- 172.21.15.113:0/1446153282 >> 172.21.15.113:0/1446153282 conn(0x7fa6d00cc970 msgr2=0x7fa6d00ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 -- 172.21.15.113:0/1446153282 shutdown_connections 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.107+0000 7fa6d491e640 1 -- 172.21.15.113:0/1446153282 wait complete. 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.108+0000 7fa6d491e640 1 Processor -- start 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.108+0000 7fa6d491e640 1 -- start start 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d009e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d0070160 0x7fa6d00cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d006e480 con 0x7fa6d006fd80 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d015b4e0 con 0x7fa6d0070160 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d01f45f0 con 0x7fa6d006dad0 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34388/0 (socket says 172.21.15.113:34388) 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1741583759 learned_addr learned my addr 172.21.15.113:0/1741583759 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6ced9d640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d0070160 0x7fa6d00cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6ce59c640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d009e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 msgr2=0x7fa6d009e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d009e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d0070160 msgr2=0x7fa6d00cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d0070160 0x7fa6d00cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 -- 172.21.15.113:0/1741583759 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d01ee090 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6ce59c640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d009e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c7fff640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa6b802b8c0 tx=0x7fa6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8032880 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b8032a40 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d01f3cc0 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8032e30 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.109+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d01f4280 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.110+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d01f4770 con 0x7fa6d006fd80 2024-02-26T12:19:35.098 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.111+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6b804c060 con 0x7fa6d006fd80 2024-02-26T12:19:35.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.111+0000 7fa6c6ffd640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 0x7fa6b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:35.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.111+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6b80abcc0 con 0x7fa6d006fd80 2024-02-26T12:19:35.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.111+0000 7fa6ce59c640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 0x7fa6b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:35.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.111+0000 7fa6ce59c640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 0x7fa6b006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006fd0 tx=0x7fa6c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:35.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.115+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6d01ee090 con 0x7fa6d006fd80 2024-02-26T12:19:35.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.322+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6d0074a50 con 0x7fa6d006fd80 2024-02-26T12:19:35.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.322+0000 7fa6c6ffd640 1 -- 172.21.15.113:0/1741583759 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6b8040070 con 0x7fa6d006fd80 2024-02-26T12:19:35.308 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-26T12:19:35.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 msgr2=0x7fa6b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:35.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 0x7fa6b006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0006fd0 tx=0x7fa6c0008040 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 msgr2=0x7fa6d00c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa6b802b8c0 tx=0x7fa6b80046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 shutdown_connections 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa6b006b4d0 0x7fa6b006d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6d0070160 0x7fa6d00cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d006fd80 0x7fa6d00c98d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 --2- 172.21.15.113:0/1741583759 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6d006dad0 0x7fa6d009e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 >> 172.21.15.113:0/1741583759 conn(0x7fa6d00cc970 msgr2=0x7fa6d00ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 shutdown_connections 2024-02-26T12:19:35.310 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:35.324+0000 7fa6d491e640 1 -- 172.21.15.113:0/1741583759 wait complete. 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-26T12:19:35.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-26T12:19:35.321 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-26T12:19:35.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.321 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-02-26T12:19:35.339 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:35.340 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-02-26T12:19:35.341 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:35.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-26T12:19:35.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-26T12:19:35.342 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:35.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.540 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-26T12:19:35.566 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-02-26T12:19:35.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.568 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-02-26T12:19:35.638 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-02-26T12:19:35.638 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-26T12:19:35.638 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-26T12:19:35.638 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-26T12:19:35.638 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-26T12:19:35.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-26T12:19:35.639 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:35.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.893 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:19:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.908 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-02-26T12:19:35.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:35.963 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:35.963 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:35.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-26T12:19:35.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-26T12:19:35.963 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:36.047 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-26T12:19:36.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-26T12:19:36.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-26T12:19:36.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-26T12:19:36.048 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:36.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.190 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:36.190 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:36.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-02-26T12:19:36.191 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-02-26T12:19:36.191 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:36.233 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:36.234 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-26T12:19:36.289 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-26T12:19:36.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:36.289 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-26T12:19:36.344 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-02-26T12:19:36.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:36.445 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:36.445 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:36.553 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:36.553 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:36.553 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.152:3300,172.21.15.152:3301" 2024-02-26T12:19:36.553 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 1@74a57275-9dde-4d5b-99d3-80ee62f4964a.cephfs=/ 2024-02-26T12:19:36.553 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.113:3300/172.21.15.152:3300/172.21.15.152:3301" will pass to kernel 2024-02-26T12:19:36.554 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-26T12:19:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-02-26T12:19:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-26T12:19:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-02-26T12:19:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-26T12:19:36.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-26T12:19:36.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.556 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-26T12:19:36.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.591 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:36.647 INFO:teuthology.orchestra.run.smithi152.stdout:client4629 2024-02-26T12:19:36.647 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:36.647 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:36.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.702 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:36.758 INFO:teuthology.orchestra.run.smithi152.stdout:client4629 2024-02-26T12:19:36.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.758 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:36.814 INFO:teuthology.orchestra.run.smithi152.stdout:client4629 2024-02-26T12:19:36.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:36.814 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/74a57275-9dde-4d5b-99d3-80ee62f4964a.client4629/status') 2024-02-26T12:19:36.880 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4629 (3)172.21.15.152:0/394063849 2024-02-26T12:19:36.881 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-02-26T12:19:36.881 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-02-26T12:19:36.881 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-02-26T12:19:36.881 INFO:teuthology.orchestra.run.smithi152.stderr:70 bytes copied, 2.1478e-05 s, 3.3 MB/s 2024-02-26T12:19:36.882 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-02-26T12:19:36.882 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-26T12:19:36.882 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-26T12:19:36.882 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-26T12:19:36.994 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.009+0000 7f1c4ff5d640 1 Processor -- start 2024-02-26T12:19:36.995 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.009+0000 7f1c4ff5d640 1 -- start start 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4ff5d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c481655b0 0x7f1c480b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4ff5d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c480b2b90 0x7f1c480b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4ff5d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c48165990 con 0x7f1c480b35e0 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4ff5d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c48071ea0 con 0x7f1c480b2b90 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4ff5d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480b3a70 con 0x7f1c481655b0 2024-02-26T12:19:36.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4d4f8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c480b2b90 0x7f1c480b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.010+0000 7f1c4d4f8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1c480b2b90 0x7f1c480b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34400/0 (socket says 172.21.15.113:34400) 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4d4f8640 1 -- 172.21.15.113:0/1595090340 learned_addr learned my addr 172.21.15.113:0/1595090340 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4dcf9640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c481655b0 0x7f1c480b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4d4f8640 1 -- 172.21.15.113:0/1595090340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c481655b0 msgr2=0x7f1c480b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4d4f8640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c481655b0 0x7f1c480b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4d4f8640 1 -- 172.21.15.113:0/1595090340 >> v1:172.21.15.152:6789/0 conn(0x7f1c480b35e0 legacy=0x7f1c4806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:36.997 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.011+0000 7f1c4d4f8640 1 -- 172.21.15.113:0/1595090340 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48071290 con 0x7f1c480b2b90 2024-02-26T12:19:36.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4d4f8640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480b30a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009870 tx=0x7f1c3802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cb67b52ade477d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ccf7640 1 -- 172.21.15.113:0/1595090340 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38035020 con 0x7f1c480b2b90 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ccf7640 1 -- 172.21.15.113:0/1595090340 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38031640 con 0x7f1c480b2b90 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ccf7640 1 -- 172.21.15.113:0/1595090340 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3802d040 con 0x7f1c480b2b90 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/1595090340 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 msgr2=0x7f1c480b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480b30a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c38009870 tx=0x7f1c3802b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/1595090340 shutdown_connections 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480b30a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/1595090340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c481655b0 0x7f1c480b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/1595090340 >> 172.21.15.113:0/1595090340 conn(0x7f1c4806ab50 msgr2=0x7f1c4806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:36.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/1595090340 shutdown_connections 2024-02-26T12:19:37.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.012+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/1595090340 wait complete. 2024-02-26T12:19:37.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.013+0000 7f1c4ff5d640 1 Processor -- start 2024-02-26T12:19:37.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 -- start start 2024-02-26T12:19:37.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:37.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c480b35e0 0x7f1c480af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:37.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 0x7f1c480af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:37.002 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48071b30 con 0x7f1c480b2b90 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48071850 con 0x7f1c481655b0 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4ff5d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48166ac0 con 0x7f1c480b35e0 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4dcf9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4dcf9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:34402/0 (socket says 172.21.15.113:34402) 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4dcf9640 1 -- 172.21.15.113:0/3286250799 learned_addr learned my addr 172.21.15.113:0/3286250799 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4d4f8640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c480b35e0 0x7f1c480af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.014+0000 7f1c4e4fa640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 0x7f1c480af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 -- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c480b35e0 msgr2=0x7f1c480af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c480b35e0 0x7f1c480af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 -- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 msgr2=0x7f1c480af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 0x7f1c480af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 -- 172.21.15.113:0/3286250799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480d0360 con 0x7f1c480b2b90 2024-02-26T12:19:37.003 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4e4fa640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 0x7f1c480af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4dcf9640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009db0 tx=0x7f1c4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44018020 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44014480 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c480ac8a0 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44014850 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.015+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c480ace60 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.016+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c48074a50 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.016+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c44005d10 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.017+0000 7f1c3e7fc640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 0x7f1c2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.017+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c4408ac90 con 0x7f1c480b2b90 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.017+0000 7f1c4d4f8640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 0x7f1c2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:37.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.017+0000 7f1c4d4f8640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 0x7f1c2c06d9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c38036000 tx=0x7f1c3803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:37.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.021+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c44022070 con 0x7f1c480b2b90 2024-02-26T12:19:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.228+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c4806d4f0 con 0x7f1c480b2b90 2024-02-26T12:19:37.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.228+0000 7f1c3e7fc640 1 -- 172.21.15.113:0/3286250799 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c480d0360 con 0x7f1c480b2b90 2024-02-26T12:19:37.213 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-26T12:19:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 msgr2=0x7f1c2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:37.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 0x7f1c2c06d9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c38036000 tx=0x7f1c3803c040 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 msgr2=0x7f1c480ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009db0 tx=0x7f1c4400c490 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 shutdown_connections 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1c2c06b500 0x7f1c2c06d9c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c481655b0 0x7f1c480af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1c480b35e0 0x7f1c480af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 --2- 172.21.15.113:0/3286250799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1c480b2b90 0x7f1c480ac1c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 >> 172.21.15.113:0/3286250799 conn(0x7f1c4806ab50 msgr2=0x7f1c4806dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 shutdown_connections 2024-02-26T12:19:37.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:37.230+0000 7f1c4ff5d640 1 -- 172.21.15.113:0/3286250799 wait complete. 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-26T12:19:37.226 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-02-26T12:19:37.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.227 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-02-26T12:19:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42702sec preferred_lft 42702sec 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether ba:3a:27:71:02:c6 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:19:37.244 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::e402:7bff:fe6a:803b/64 scope link 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether ba:3a:27:71:02:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::b83a:27ff:fe71:2c6/64 scope link tentative 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.245 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-26T12:19:37.309 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-02-26T12:19:37.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.312 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-02-26T12:19:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-02-26T12:19:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-26T12:19:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-26T12:19:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-26T12:19:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-26T12:19:37.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-26T12:19:37.369 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:37.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.465 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:19:37.479 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-26T12:19:37.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.480 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-02-26T12:19:37.535 INFO:teuthology.orchestra.run.smithi152.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-02-26T12:19:37.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.535 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:37.535 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:37.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-26T12:19:37.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-02-26T12:19:37.536 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:37.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.617 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-26T12:19:37.683 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:37.683 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 1e:99:b2:c6:e3:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::1c99:b2ff:fec6:e3c0/64 scope link tentative 2024-02-26T12:19:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.685 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-02-26T12:19:37.753 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 1e:99:b2:c6:e3:c0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::1c99:b2ff:fec6:e3c0/64 scope link tentative 2024-02-26T12:19:37.754 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:19:37.755 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-02-26T12:19:37.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.755 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:37.755 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-02-26T12:19:37.756 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:37.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.881 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2024-02-26T12:19:37.881 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-02-26T12:19:37.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.1 up 2024-02-26T12:19:37.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.1 master ceph-brx 2024-02-26T12:19:37.882 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-02-26T12:19:37.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:37.928 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-02-26T12:19:37.945 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-02-26T12:19:37.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:19:37.945 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-02-26T12:19:37.996 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-02-26T12:19:37.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:37.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:38.080 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:38.080 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:38.088 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:19:38.088 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:19:38.088 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.152:3300,172.21.15.152:3301" 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 3@74a57275-9dde-4d5b-99d3-80ee62f4964a.cephfs=/ 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.113:3300/172.21.15.152:3300/172.21.15.152:3301" will pass to kernel 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-02-26T12:19:38.089 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-26T12:19:38.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-26T12:19:38.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:38.091 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-02-26T12:19:38.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:38.123 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:38.180 INFO:teuthology.orchestra.run.smithi152.stdout:client4638 2024-02-26T12:19:38.180 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:38.180 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:38.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:38.236 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:38.291 INFO:teuthology.orchestra.run.smithi152.stdout:client4638 2024-02-26T12:19:38.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:38.292 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:19:38.347 INFO:teuthology.orchestra.run.smithi152.stdout:client4638 2024-02-26T12:19:38.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:38.348 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/74a57275-9dde-4d5b-99d3-80ee62f4964a.client4638/status') 2024-02-26T12:19:38.414 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4638 (3)172.21.15.152:0/2211134987 2024-02-26T12:19:38.414 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-02-26T12:19:38.414 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-02-26T12:19:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-02-26T12:19:38.415 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 2.1723e-05 s, 3.3 MB/s 2024-02-26T12:19:38.416 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-02-26T12:19:38.438 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:38.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.565+0000 7f5ef3684640 1 Processor -- start 2024-02-26T12:19:38.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.565+0000 7f5ef3684640 1 -- start start 2024-02-26T12:19:38.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef3684640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5eec15bb50 0x7f5eec0716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef3684640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 0x7f5eec0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef3684640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec071bf0 con 0x7f5eec0b3350 2024-02-26T12:19:38.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef3684640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec070c60 con 0x7f5eec15bb50 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef3684640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec0cc5f0 con 0x7f5eec0d0d00 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5eec15bb50 0x7f5eec0716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5eec15bb50 0x7f5eec0716b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47414/0 (socket says 172.21.15.113:47414) 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 -- 172.21.15.113:0/2918919791 learned_addr learned my addr 172.21.15.113:0/2918919791 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef0c1f640 1 --2- 172.21.15.113:0/2918919791 >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 0x7f5eec0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 -- 172.21.15.113:0/2918919791 >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 msgr2=0x7f5eec0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 --2- 172.21.15.113:0/2918919791 >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 0x7f5eec0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 -- 172.21.15.113:0/2918919791 >> v1:172.21.15.152:6789/0 conn(0x7f5eec0b3350 legacy=0x7f5eec0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef1420640 1 -- 172.21.15.113:0/2918919791 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0cc8a0 con 0x7f5eec15bb50 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.566+0000 7f5ef0c1f640 1 --2- 172.21.15.113:0/2918919791 >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 0x7f5eec0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.567+0000 7f5ef1420640 1 --2- 172.21.15.113:0/2918919791 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0716b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0cef90 tx=0x7f5ee802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d4ff402c302545 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.567+0000 7f5ee3fff640 1 -- 172.21.15.113:0/2918919791 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee802e070 con 0x7f5eec15bb50 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.567+0000 7f5ee3fff640 1 -- 172.21.15.113:0/2918919791 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8037070 con 0x7f5eec15bb50 2024-02-26T12:19:38.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.567+0000 7f5ee3fff640 1 -- 172.21.15.113:0/2918919791 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8031a00 con 0x7f5eec15bb50 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 -- 172.21.15.113:0/2918919791 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 msgr2=0x7f5eec0716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 --2- 172.21.15.113:0/2918919791 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0716b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0cef90 tx=0x7f5ee802b880 comp rx=0 tx=0).stop 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 -- 172.21.15.113:0/2918919791 shutdown_connections 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 --2- 172.21.15.113:0/2918919791 >> v2:172.21.15.152:3300/0 conn(0x7f5eec0d0d00 0x7f5eec0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 --2- 172.21.15.113:0/2918919791 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0716b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 -- 172.21.15.113:0/2918919791 >> 172.21.15.113:0/2918919791 conn(0x7f5eec0ce350 msgr2=0x7f5eec0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 -- 172.21.15.113:0/2918919791 shutdown_connections 2024-02-26T12:19:38.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.568+0000 7f5ef3684640 1 -- 172.21.15.113:0/2918919791 wait complete. 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.569+0000 7f5ef3684640 1 Processor -- start 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.569+0000 7f5ef3684640 1 -- start start 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5eec0b3350 0x7f5eec14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eec0d0d00 0x7f5eec0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec071190 con 0x7f5eec15bb50 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec070eb0 con 0x7f5eec0d0d00 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec15bf30 con 0x7f5eec0b3350 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef0c1f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eec0d0d00 0x7f5eec0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1420640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5eec0b3350 0x7f5eec14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47416/0 (socket says 172.21.15.113:47416) 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 -- 172.21.15.113:0/3353380633 learned_addr learned my addr 172.21.15.113:0/3353380633 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:38.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 -- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5eec0b3350 msgr2=0x7f5eec14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5eec0b3350 0x7f5eec14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 -- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eec0d0d00 msgr2=0x7f5eec0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eec0d0d00 0x7f5eec0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 -- 172.21.15.113:0/3353380633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec150710 con 0x7f5eec15bb50 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef1c21640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400b970 tx=0x7f5ee400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4019070 con 0x7f5eec15bb50 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee400cb40 con 0x7f5eec15bb50 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec153d70 con 0x7f5eec15bb50 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.570+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4014440 con 0x7f5eec15bb50 2024-02-26T12:19:38.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.571+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec15c5c0 con 0x7f5eec15bb50 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.572+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec074a50 con 0x7f5eec15bb50 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.572+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ee401c070 con 0x7f5eec15bb50 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.572+0000 7f5ee1ffb640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 0x7f5ed006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.572+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ee4089d30 con 0x7f5eec15bb50 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.572+0000 7f5ef1420640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 0x7f5ed006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.573+0000 7f5ef1420640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 0x7f5ed006d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8036000 tx=0x7f5ee803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.577+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5eec150710 con 0x7f5eec15bb50 2024-02-26T12:19:38.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.749+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eec0d0ac0 con 0x7f5eec15bb50 2024-02-26T12:19:38.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.750+0000 7f5ee1ffb640 1 -- 172.21.15.113:0/3353380633 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f5ee4058560 con 0x7f5eec15bb50 2024-02-26T12:19:38.736 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:38.736 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 msgr2=0x7f5ed006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 0x7f5ed006d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8036000 tx=0x7f5ee803d040 comp rx=0 tx=0).stop 2024-02-26T12:19:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 msgr2=0x7f5eec0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400b970 tx=0x7f5ee400be30 comp rx=0 tx=0).stop 2024-02-26T12:19:38.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 shutdown_connections 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5ed006b4d0 0x7f5ed006d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eec15bb50 0x7f5eec0b5b80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5eec0d0d00 0x7f5eec0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 --2- 172.21.15.113:0/3353380633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5eec0b3350 0x7f5eec14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 >> 172.21.15.113:0/3353380633 conn(0x7f5eec0ce350 msgr2=0x7f5eec0b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 shutdown_connections 2024-02-26T12:19:38.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.752+0000 7f5ef3684640 1 -- 172.21.15.113:0/3353380633 wait complete. 2024-02-26T12:19:38.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:38.749 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:38.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.866+0000 7f2f5f784640 1 Processor -- start 2024-02-26T12:19:38.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 -- start start 2024-02-26T12:19:38.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2f5815f270 0x7f2f5809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f580b0740 0x7f2f580cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580d0520 con 0x7f2f580cd650 2024-02-26T12:19:38.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5815f650 con 0x7f2f580b0740 2024-02-26T12:19:38.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5f784640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5809b1d0 con 0x7f2f5815f270 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.867+0000 7f2f5cd1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f580b0740 0x7f2f580cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2f580b0740 0x7f2f580cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47420/0 (socket says 172.21.15.113:47420) 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/1063085123 learned_addr learned my addr 172.21.15.113:0/1063085123 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5d520640 1 --2- 172.21.15.113:0/1063085123 >> v2:172.21.15.152:3300/0 conn(0x7f2f5815f270 0x7f2f5809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/1063085123 >> v2:172.21.15.152:3300/0 conn(0x7f2f5815f270 msgr2=0x7f2f5809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 --2- 172.21.15.113:0/1063085123 >> v2:172.21.15.152:3300/0 conn(0x7f2f5815f270 0x7f2f5809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/1063085123 >> v1:172.21.15.152:6789/0 conn(0x7f2f580cd650 legacy=0x7f2f580ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.868+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/1063085123 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580d0800 con 0x7f2f580b0740 2024-02-26T12:19:38.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5cd1f640 1 --2- 172.21.15.113:0/1063085123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580b0740 0x7f2f580cd110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f58073120 tx=0x7f2f4802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dd1bed2f37b0da server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f4ffff640 1 -- 172.21.15.113:0/1063085123 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48034070 con 0x7f2f580b0740 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f4ffff640 1 -- 172.21.15.113:0/1063085123 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48030860 con 0x7f2f580b0740 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f4ffff640 1 -- 172.21.15.113:0/1063085123 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48030c30 con 0x7f2f580b0740 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 -- 172.21.15.113:0/1063085123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580b0740 msgr2=0x7f2f580cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 --2- 172.21.15.113:0/1063085123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580b0740 0x7f2f580cd110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2f58073120 tx=0x7f2f4802b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 -- 172.21.15.113:0/1063085123 shutdown_connections 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 --2- 172.21.15.113:0/1063085123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580b0740 0x7f2f580cd110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 --2- 172.21.15.113:0/1063085123 >> v2:172.21.15.152:3300/0 conn(0x7f2f5815f270 0x7f2f5809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 -- 172.21.15.113:0/1063085123 >> 172.21.15.113:0/1063085123 conn(0x7f2f580b33d0 msgr2=0x7f2f580b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 -- 172.21.15.113:0/1063085123 shutdown_connections 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.869+0000 7f2f5f784640 1 -- 172.21.15.113:0/1063085123 wait complete. 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.870+0000 7f2f5f784640 1 Processor -- start 2024-02-26T12:19:38.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 -- start start 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f580b0740 0x7f2f580aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 0x7f2f5815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580d01f0 con 0x7f2f580cd650 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580ccbf0 con 0x7f2f5815f270 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5f784640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580cc530 con 0x7f2f580b0740 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5cd1f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5cd1f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47430/0 (socket says 172.21.15.113:47430) 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.871+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/803053413 learned_addr learned my addr 172.21.15.113:0/803053413 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f580b0740 msgr2=0x7f2f580aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f580b0740 0x7f2f580aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 msgr2=0x7f2f5815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:38.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5dd21640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 0x7f2f5815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 0x7f2f5815e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 -- 172.21.15.113:0/803053413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f581f2da0 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5dd21640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 0x7f2f5815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5cd1f640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802b9e0 tx=0x7f2f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48034040 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48039d90 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48043630 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5815c860 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.872+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5815ce20 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.873+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58074a50 con 0x7f2f580cd650 2024-02-26T12:19:38.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.874+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f48037070 con 0x7f2f580cd650 2024-02-26T12:19:38.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.874+0000 7f2f4dffb640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 0x7f2f3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:38.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.874+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f480ac250 con 0x7f2f580cd650 2024-02-26T12:19:38.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.874+0000 7f2f5d520640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 0x7f2f3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:38.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.874+0000 7f2f5d520640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 0x7f2f3c06d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f580b2ab0 tx=0x7f2f5400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:38.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:38.878+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f4803e070 con 0x7f2f580cd650 2024-02-26T12:19:39.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.047+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f580b4030 con 0x7f2f580cd650 2024-02-26T12:19:39.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.048+0000 7f2f4dffb640 1 -- 172.21.15.113:0/803053413 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f4807b0d0 con 0x7f2f580cd650 2024-02-26T12:19:39.033 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 msgr2=0x7f2f3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 0x7f2f3c06d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f580b2ab0 tx=0x7f2f5400b040 comp rx=0 tx=0).stop 2024-02-26T12:19:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 msgr2=0x7f2f5815e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802b9e0 tx=0x7f2f480046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 shutdown_connections 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2f3c06b4d0 0x7f2f3c06d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f5815f270 0x7f2f5815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2f580cd650 0x7f2f5815e120 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 --2- 172.21.15.113:0/803053413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f580b0740 0x7f2f580aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 >> 172.21.15.113:0/803053413 conn(0x7f2f580b33d0 msgr2=0x7f2f581580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 shutdown_connections 2024-02-26T12:19:39.036 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.050+0000 7f2f5f784640 1 -- 172.21.15.113:0/803053413 wait complete. 2024-02-26T12:19:39.046 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:39.148 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.163+0000 7f1e7ed1e640 1 Processor -- start 2024-02-26T12:19:39.149 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.163+0000 7f1e7ed1e640 1 -- start start 2024-02-26T12:19:39.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7ed1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e7815de30 0x7f1e780b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7ed1e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1e780ceb00 0x7f1e780d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7ed1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780d1dc0 con 0x7f1e780b5b50 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7ed1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e78161d50 con 0x7f1e7815de30 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7ed1e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780cf000 con 0x7f1e780ceb00 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e7815de30 0x7f1e780b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e7815de30 0x7f1e780b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47446/0 (socket says 172.21.15.113:47446) 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 -- 172.21.15.113:0/175519777 learned_addr learned my addr 172.21.15.113:0/175519777 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7d2bb640 1 --2- 172.21.15.113:0/175519777 >> v2:172.21.15.152:3300/0 conn(0x7f1e780ceb00 0x7f1e780d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 -- 172.21.15.113:0/175519777 >> v2:172.21.15.152:3300/0 conn(0x7f1e780ceb00 msgr2=0x7f1e780d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 --2- 172.21.15.113:0/175519777 >> v2:172.21.15.152:3300/0 conn(0x7f1e780ceb00 0x7f1e780d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 -- 172.21.15.113:0/175519777 >> v1:172.21.15.152:6789/0 conn(0x7f1e780b5b50 legacy=0x7f1e780ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.164+0000 7f1e7caba640 1 -- 172.21.15.113:0/175519777 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780d2060 con 0x7f1e7815de30 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.165+0000 7f1e7caba640 1 --2- 172.21.15.113:0/175519777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b5610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e780b62f0 tx=0x7f1e6802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4466f790f6740fad server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.165+0000 7f1e777fe640 1 -- 172.21.15.113:0/175519777 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68034070 con 0x7f1e7815de30 2024-02-26T12:19:39.151 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.165+0000 7f1e777fe640 1 -- 172.21.15.113:0/175519777 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68030860 con 0x7f1e7815de30 2024-02-26T12:19:39.152 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.165+0000 7f1e777fe640 1 -- 172.21.15.113:0/175519777 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68030c30 con 0x7f1e7815de30 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/175519777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 msgr2=0x7f1e780b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/175519777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b5610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e780b62f0 tx=0x7f1e6802b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/175519777 shutdown_connections 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/175519777 >> v2:172.21.15.152:3300/0 conn(0x7f1e780ceb00 0x7f1e780d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/175519777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b5610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/175519777 >> 172.21.15.113:0/175519777 conn(0x7f1e780d0610 msgr2=0x7f1e780d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/175519777 shutdown_connections 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.166+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/175519777 wait complete. 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.167+0000 7f1e7ed1e640 1 Processor -- start 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.167+0000 7f1e7ed1e640 1 -- start start 2024-02-26T12:19:39.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 0x7f1e780cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 0x7f1e781508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7815e210 con 0x7f1e7815de30 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780b6dc0 con 0x7f1e780ceb00 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7ed1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780cf2e0 con 0x7f1e780b5b50 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47452/0 (socket says 172.21.15.113:47452) 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 -- 172.21.15.113:0/301667209 learned_addr learned my addr 172.21.15.113:0/301667209 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e77fff640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 0x7f1e781508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7caba640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 0x7f1e780cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 -- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 msgr2=0x7f1e780cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 0x7f1e780cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 -- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 msgr2=0x7f1e781508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 0x7f1e781508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7d2bb640 1 -- 172.21.15.113:0/301667209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780b75a0 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e77fff640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 0x7f1e781508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.168+0000 7f1e7caba640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 0x7f1e780cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e7d2bb640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e70007e30 tx=0x7f1e7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70014620 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70019070 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e780b7840 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70014a00 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.169+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e780b7e00 con 0x7f1e7815de30 2024-02-26T12:19:39.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.170+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e78074a50 con 0x7f1e7815de30 2024-02-26T12:19:39.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.170+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e70014ba0 con 0x7f1e7815de30 2024-02-26T12:19:39.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.171+0000 7f1e757fa640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 0x7f1e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.171+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e7008aae0 con 0x7f1e7815de30 2024-02-26T12:19:39.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.171+0000 7f1e7caba640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 0x7f1e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.171+0000 7f1e7caba640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 0x7f1e6406d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e68036000 tx=0x7f1e6803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.175+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e70059960 con 0x7f1e7815de30 2024-02-26T12:19:39.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.344+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e780d18d0 con 0x7f1e7815de30 2024-02-26T12:19:39.330 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.345+0000 7f1e757fa640 1 -- 172.21.15.113:0/301667209 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e70059260 con 0x7f1e7815de30 2024-02-26T12:19:39.330 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 msgr2=0x7f1e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 0x7f1e6406d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e68036000 tx=0x7f1e6803b040 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 msgr2=0x7f1e780b8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e70007e30 tx=0x7f1e7000e4b0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 shutdown_connections 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6406b4d0 0x7f1e6406d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7815de30 0x7f1e780b8e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e780ceb00 0x7f1e781508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.346+0000 7f1e7ed1e640 1 --2- 172.21.15.113:0/301667209 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e780b5b50 0x7f1e780cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.347+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 >> 172.21.15.113:0/301667209 conn(0x7f1e780d0610 msgr2=0x7f1e780b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.332 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.347+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 shutdown_connections 2024-02-26T12:19:39.333 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.347+0000 7f1e7ed1e640 1 -- 172.21.15.113:0/301667209 wait complete. 2024-02-26T12:19:39.342 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:39.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.461+0000 7ffbfb91e640 1 Processor -- start 2024-02-26T12:19:39.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.461+0000 7ffbfb91e640 1 -- start start 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbfb91e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbfb91e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 0x7ffbf4099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbfb91e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf40b32c0 con 0x7ffbf4099f80 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbfb91e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf409a3f0 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbfb91e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40cfd80 con 0x7ffbf409aa80 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbf96ba640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbf8eb9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 0x7ffbf4099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbf96ba640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:44260/0 (socket says 172.21.15.113:44260) 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbf9ebb640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ffbf4099f80 0x7ffbf40cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47244/0 (socket says 172.21.15.113:47244) 2024-02-26T12:19:39.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.462+0000 7ffbf96ba640 1 -- 172.21.15.113:0/2310985401 learned_addr learned my addr 172.21.15.113:0/2310985401 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf96ba640 1 -- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 msgr2=0x7ffbf4099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf96ba640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 0x7ffbf4099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf96ba640 1 -- 172.21.15.113:0/2310985401 >> v1:172.21.15.152:6789/0 conn(0x7ffbf4099f80 legacy=0x7ffbf40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf96ba640 1 -- 172.21.15.113:0/2310985401 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf40c56b0 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.449 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf8eb9640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 0x7ffbf4099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.463+0000 7ffbf96ba640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0009870 tx=0x7ffbf002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9707940d88f61add server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbe7fff640 1 -- 172.21.15.113:0/2310985401 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbf0034070 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbe7fff640 1 -- 172.21.15.113:0/2310985401 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbf0030840 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.450 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbe7fff640 1 -- 172.21.15.113:0/2310985401 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbf0030c10 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf40b2ee0 msgr2=0x7ffbf40cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0009870 tx=0x7ffbf002b980 comp rx=0 tx=0).stop 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2310985401 shutdown_connections 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf409aa80 0x7ffbf4099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2310985401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf40b2ee0 0x7ffbf40cf7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2310985401 >> 172.21.15.113:0/2310985401 conn(0x7ffbf40b34b0 msgr2=0x7ffbf40b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2310985401 shutdown_connections 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.464+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2310985401 wait complete. 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.465+0000 7ffbfb91e640 1 Processor -- start 2024-02-26T12:19:39.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.465+0000 7ffbfb91e640 1 -- start start 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf4099f80 0x7ffbf4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 0x7ffbf4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40c5f50 con 0x7ffbf409aa80 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40c5c70 con 0x7ffbf4099f80 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbfb91e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf409aee0 con 0x7ffbf40b2ee0 2024-02-26T12:19:39.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbf8eb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbf8eb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47468/0 (socket says 172.21.15.113:47468) 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbf8eb9640 1 -- 172.21.15.113:0/2049923129 learned_addr learned my addr 172.21.15.113:0/2049923129 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbf96ba640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf4099f80 0x7ffbf4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.466+0000 7ffbf9ebb640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 0x7ffbf4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 -- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 msgr2=0x7ffbf4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 0x7ffbf4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 -- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf4099f80 msgr2=0x7ffbf4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf4099f80 0x7ffbf4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 -- 172.21.15.113:0/2049923129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf41f5090 con 0x7ffbf409aa80 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf9ebb640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 0x7ffbf4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbf8eb9640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800e960 tx=0x7ffbe800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe8017070 con 0x7ffbf409aa80 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe800ca00 con 0x7ffbf409aa80 2024-02-26T12:19:39.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe800cdd0 con 0x7ffbf409aa80 2024-02-26T12:19:39.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf4156950 con 0x7ffbf409aa80 2024-02-26T12:19:39.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.467+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf4156f10 con 0x7ffbf409aa80 2024-02-26T12:19:39.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.468+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf4074a50 con 0x7ffbf409aa80 2024-02-26T12:19:39.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.468+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffbe801a070 con 0x7ffbf409aa80 2024-02-26T12:19:39.455 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.469+0000 7ffbe5ffb640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 0x7ffbd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.469+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbe808a0b0 con 0x7ffbf409aa80 2024-02-26T12:19:39.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.469+0000 7ffbf96ba640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 0x7ffbd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.469+0000 7ffbf96ba640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 0x7ffbd806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0036000 tx=0x7ffbf003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.458 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.473+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffbe8058f30 con 0x7ffbf409aa80 2024-02-26T12:19:39.631 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.645+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbf4070560 con 0x7ffbf409aa80 2024-02-26T12:19:39.631 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.646+0000 7ffbe5ffb640 1 -- 172.21.15.113:0/2049923129 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbe8058830 con 0x7ffbf409aa80 2024-02-26T12:19:39.631 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:39.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 msgr2=0x7ffbd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 0x7ffbd806d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0036000 tx=0x7ffbf003b040 comp rx=0 tx=0).stop 2024-02-26T12:19:39.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 msgr2=0x7ffbf41f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ffbe800e960 tx=0x7ffbe800ee20 comp rx=0 tx=0).stop 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 shutdown_connections 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffbd806b4d0 0x7ffbd806d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffbf40b2ee0 0x7ffbf4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbf409aa80 0x7ffbf41f4b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 --2- 172.21.15.113:0/2049923129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffbf4099f80 0x7ffbf4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 >> 172.21.15.113:0/2049923129 conn(0x7ffbf40b34b0 msgr2=0x7ffbf40c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 shutdown_connections 2024-02-26T12:19:39.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.648+0000 7ffbfb91e640 1 -- 172.21.15.113:0/2049923129 wait complete. 2024-02-26T12:19:39.644 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:39.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.763+0000 7fadf2e08640 1 Processor -- start 2024-02-26T12:19:39.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.763+0000 7fadf2e08640 1 -- start start 2024-02-26T12:19:39.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf2e08640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fadec06ab50 0x7fadec06af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf2e08640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7fadec0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf2e08640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0b6670 con 0x7fadec0b35b0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf2e08640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec1618c0 con 0x7fadec06ab50 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf2e08640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0cadb0 con 0x7fadec0b1720 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadebfff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fadec0b35b0 0x7fadec0cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48786/0 (socket says 172.21.15.113:48786) 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadebfff640 1 -- 172.21.15.113:0/3906172196 learned_addr learned my addr 172.21.15.113:0/3906172196 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834760584 0 0) 0x7fadec0b6670 con 0x7fadec0b35b0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003520 con 0x7fadec0b35b0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3906172196 >> v2:172.21.15.152:3300/0 conn(0x7fadec06ab50 0x7fadec06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf13a5640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7fadec0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1956556706 0 0) 0x7faddc003520 con 0x7fadec0b35b0 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 msgr2=0x7fadec0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7fadec0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 >> v2:172.21.15.152:3300/0 conn(0x7fadec06ab50 msgr2=0x7fadec06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 --2- 172.21.15.113:0/3906172196 >> v2:172.21.15.152:3300/0 conn(0x7fadec06ab50 0x7fadec06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec06b470 con 0x7fadec0b35b0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fadd8001670 con 0x7fadec0b35b0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 >> v1:172.21.15.113:6789/0 conn(0x7fadec0b35b0 legacy=0x7fadec0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faddc0039b0 0x7faddc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7faddc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faddc004d40 0x7faddc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec1618c0 con 0x7faddc0039b0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0cadb0 con 0x7faddc004d40 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc00b9f0 con 0x7fadec0b1720 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.764+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faddc0039b0 0x7faddc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadebfff640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7faddc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf13a5640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faddc004d40 0x7faddc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.754 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 -- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 msgr2=0x7faddc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec0b1720 0x7faddc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 -- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faddc004d40 msgr2=0x7faddc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faddc004d40 0x7faddc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 -- 172.21.15.113:0/3906172196 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc003520 con 0x7faddc0039b0 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.765+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faddc0039b0 0x7faddc003dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ac0 tx=0x7faddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fa4b877b02e10f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0039070 con 0x7faddc0039b0 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade002c710 con 0x7faddc0039b0 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadeb7fe640 1 -- 172.21.15.113:0/3906172196 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0009690 con 0x7faddc0039b0 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 -- 172.21.15.113:0/3906172196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faddc0039b0 msgr2=0x7faddc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3906172196 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faddc0039b0 0x7faddc003dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ac0 tx=0x7faddc005830 comp rx=0 tx=0).stop 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf13a5640 1 -- 172.21.15.113:0/3906172196 reap_dead start 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 -- 172.21.15.113:0/3906172196 shutdown_connections 2024-02-26T12:19:39.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 -- 172.21.15.113:0/3906172196 >> 172.21.15.113:0/3906172196 conn(0x7fadec0d0760 msgr2=0x7fadec0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 -- 172.21.15.113:0/3906172196 shutdown_connections 2024-02-26T12:19:39.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.766+0000 7fadf2e08640 1 -- 172.21.15.113:0/3906172196 wait complete. 2024-02-26T12:19:39.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.767+0000 7fadf2e08640 1 Processor -- start 2024-02-26T12:19:39.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.767+0000 7fadf2e08640 1 -- start start 2024-02-26T12:19:39.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faddc0039b0 0x7fadec0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0c7d70 0x7fadec0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0cb000 con 0x7fadec156cd0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0b1f00 con 0x7fadec0c7d70 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadf2e08640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0cb2e0 con 0x7faddc0039b0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47486/0 (socket says 172.21.15.113:47486) 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 -- 172.21.15.113:0/3619453112 learned_addr learned my addr 172.21.15.113:0/3619453112 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 -- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faddc0039b0 msgr2=0x7fadec0c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faddc0039b0 0x7fadec0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 -- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0c7d70 msgr2=0x7fadec0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0c7d70 0x7fadec0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.768+0000 7fadebfff640 1 -- 172.21.15.113:0/3619453112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0ca1a0 con 0x7fadec156cd0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fadebfff640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadd8001200 tx=0x7fadd800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800c7d0 con 0x7fadec156cd0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd8018070 con 0x7fadec156cd0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec0ca480 con 0x7fadec156cd0 2024-02-26T12:19:39.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800cbd0 con 0x7fadec156cd0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.769+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec0c62f0 con 0x7fadec156cd0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.770+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec0c5e20 con 0x7fadec156cd0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.770+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fadd8013420 con 0x7fadec156cd0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.770+0000 7fade97fa640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 0x7fadd006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.771+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadd8089dd0 con 0x7fadec156cd0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.771+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 0x7fadd006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.771+0000 7fadf0ba4640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 0x7fadd006d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fade0036000 tx=0x7fade002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:39.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.775+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadd8022250 con 0x7fadec156cd0 2024-02-26T12:19:39.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.945+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadec074a50 con 0x7fadec156cd0 2024-02-26T12:19:39.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.947+0000 7fade97fa640 1 -- 172.21.15.113:0/3619453112 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fadd808b070 con 0x7fadec156cd0 2024-02-26T12:19:39.932 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:39.932 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 msgr2=0x7fadd006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 0x7fadd006d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fade0036000 tx=0x7fade002e000 comp rx=0 tx=0).stop 2024-02-26T12:19:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 msgr2=0x7fadec0c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:39.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadd8001200 tx=0x7fadd800ecd0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 shutdown_connections 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fadd006b500 0x7fadd006d9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0c7d70 0x7fadec0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fadec156cd0 0x7fadec0c7830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 --2- 172.21.15.113:0/3619453112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faddc0039b0 0x7fadec0c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 >> 172.21.15.113:0/3619453112 conn(0x7fadec0d0760 msgr2=0x7fadec0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 shutdown_connections 2024-02-26T12:19:39.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:39.949+0000 7fadf2e08640 1 -- 172.21.15.113:0/3619453112 wait complete. 2024-02-26T12:19:39.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:39.945 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:40.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.063+0000 7f5acc01c640 1 Processor -- start 2024-02-26T12:19:40.049 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 -- start start 2024-02-26T12:19:40.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 0x7f5ac406be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac40b33f0 con 0x7f5ac406b7d0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40b36d0 con 0x7f5ac41581e0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.064+0000 7f5acc01c640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40b39b0 con 0x7f5ac4161ef0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5ac9db8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 0x7f5ac406be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:49432/0 (socket says 172.21.15.113:49432) 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 -- 172.21.15.113:0/2690569432 learned_addr learned my addr 172.21.15.113:0/2690569432 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 -- 172.21.15.113:0/2690569432 >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 msgr2=0x7f5ac406be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 --2- 172.21.15.113:0/2690569432 >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 0x7f5ac406be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 -- 172.21.15.113:0/2690569432 >> v1:172.21.15.152:6789/0 conn(0x7f5ac406b7d0 legacy=0x7f5ac41617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5aca5b9640 1 -- 172.21.15.113:0/2690569432 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40b3c90 con 0x7f5ac4161ef0 2024-02-26T12:19:40.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.065+0000 7f5ac9db8640 1 --2- 172.21.15.113:0/2690569432 >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 0x7f5ac406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:40.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.066+0000 7f5aca5b9640 1 --2- 172.21.15.113:0/2690569432 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009870 tx=0x7f5abc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df8b0f21c6f43b9e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.066+0000 7f5ac8db6640 1 -- 172.21.15.113:0/2690569432 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc035020 con 0x7f5ac4161ef0 2024-02-26T12:19:40.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.066+0000 7f5ac8db6640 1 -- 172.21.15.113:0/2690569432 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc031640 con 0x7f5ac4161ef0 2024-02-26T12:19:40.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.066+0000 7f5ac8db6640 1 -- 172.21.15.113:0/2690569432 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc02d040 con 0x7f5ac4161ef0 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 -- 172.21.15.113:0/2690569432 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 msgr2=0x7f5ac406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2690569432 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009870 tx=0x7f5abc02b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 -- 172.21.15.113:0/2690569432 shutdown_connections 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2690569432 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac406efa0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2690569432 >> v2:172.21.15.152:3300/0 conn(0x7f5ac41581e0 0x7f5ac406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 -- 172.21.15.113:0/2690569432 >> 172.21.15.113:0/2690569432 conn(0x7f5ac406db80 msgr2=0x7f5ac406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 -- 172.21.15.113:0/2690569432 shutdown_connections 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.067+0000 7f5acc01c640 1 -- 172.21.15.113:0/2690569432 wait complete. 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.068+0000 7f5acc01c640 1 Processor -- start 2024-02-26T12:19:40.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.068+0000 7f5acc01c640 1 -- start start 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac41581e0 0x7f5ac41553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac406c360 con 0x7f5ac406b7d0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac41585c0 con 0x7f5ac41581e0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac406c4e0 con 0x7f5ac4161ef0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47502/0 (socket says 172.21.15.113:47502) 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 -- 172.21.15.113:0/2717061368 learned_addr learned my addr 172.21.15.113:0/2717061368 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5aca5b9640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac95b7640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac41581e0 0x7f5ac41553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.057 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 -- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 msgr2=0x7f5ac4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 -- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac41581e0 msgr2=0x7f5ac41553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac41581e0 0x7f5ac41553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 -- 172.21.15.113:0/2717061368 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac415d150 con 0x7f5ac406b7d0 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5ac9db8640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000efc0 tx=0x7f5ac000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.058 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0018020 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0014680 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac415cb90 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0014a50 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.069+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac4158ac0 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.070+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac40b4490 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.071+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ac0005d10 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.071+0000 7f5aba7fc640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 0x7f5aa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.071+0000 7f5ac95b7640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 0x7f5aa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.071+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ac008af10 con 0x7f5ac406b7d0 2024-02-26T12:19:40.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.072+0000 7f5ac95b7640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 0x7f5aa806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ce080 tx=0x7f5ab4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.076+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ac40b4490 con 0x7f5ac406b7d0 2024-02-26T12:19:40.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.246+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ac4074a50 con 0x7f5ac406b7d0 2024-02-26T12:19:40.232 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.247+0000 7f5aba7fc640 1 -- 172.21.15.113:0/2717061368 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ac0022030 con 0x7f5ac406b7d0 2024-02-26T12:19:40.232 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.248+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 msgr2=0x7f5aa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.248+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 0x7f5aa806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ce080 tx=0x7f5ab4009040 comp rx=0 tx=0).stop 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 msgr2=0x7f5ac40ae620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000efc0 tx=0x7f5ac000c490 comp rx=0 tx=0).stop 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 shutdown_connections 2024-02-26T12:19:40.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5aa806b4d0 0x7f5aa806d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ac4161ef0 0x7f5ac4155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ac41581e0 0x7f5ac41553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 --2- 172.21.15.113:0/2717061368 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac406b7d0 0x7f5ac40ae620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 >> 172.21.15.113:0/2717061368 conn(0x7f5ac406db80 msgr2=0x7f5ac4160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 shutdown_connections 2024-02-26T12:19:40.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.249+0000 7f5acc01c640 1 -- 172.21.15.113:0/2717061368 wait complete. 2024-02-26T12:19:40.245 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:40.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.363+0000 7f3e439c4640 1 Processor -- start 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.363+0000 7f3e439c4640 1 -- start start 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e439c4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 0x7f3e3c06be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e439c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e3c06b7d0 0x7f3e3c1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e439c4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0b33f0 con 0x7f3e3c161d20 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e439c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b36d0 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e439c4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b39b0 con 0x7f3e3c1581e0 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e40f5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3e3c06b7d0 0x7f3e3c1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e41f61640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e3c161d20 0x7f3e3c15e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48794/0 (socket says 172.21.15.113:48794) 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e41f61640 1 -- 172.21.15.113:0/1345319963 learned_addr learned my addr 172.21.15.113:0/1345319963 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e41760640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 0x7f3e3c06be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e40f5f640 1 -- 172.21.15.113:0/1345319963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 msgr2=0x7f3e3c06be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e40f5f640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 0x7f3e3c06be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e40f5f640 1 -- 172.21.15.113:0/1345319963 >> v1:172.21.15.113:6789/0 conn(0x7f3e3c161d20 legacy=0x7f3e3c15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e40f5f640 1 -- 172.21.15.113:0/1345319963 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0b3c90 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e33fff640 1 -- 172.21.15.113:0/1345319963 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398197687 0 0) 0x7f3e3c0b33f0 con 0x7f3e3c161d20 2024-02-26T12:19:40.351 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.364+0000 7f3e41760640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 0x7f3e3c06be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e40f5f640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c06b7d0 0x7f3e3c1617e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a15f516e6c552b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e33fff640 1 -- 172.21.15.113:0/1345319963 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0315a0 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e33fff640 1 -- 172.21.15.113:0/1345319963 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c037070 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e33fff640 1 -- 172.21.15.113:0/1345319963 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031960 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 -- 172.21.15.113:0/1345319963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c06b7d0 msgr2=0x7f3e3c1617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c06b7d0 0x7f3e3c1617e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c02b840 comp rx=0 tx=0).stop 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 -- 172.21.15.113:0/1345319963 shutdown_connections 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c06b7d0 0x7f3e3c1617e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 --2- 172.21.15.113:0/1345319963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c1581e0 0x7f3e3c06be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.365+0000 7f3e439c4640 1 -- 172.21.15.113:0/1345319963 >> 172.21.15.113:0/1345319963 conn(0x7f3e3c06db80 msgr2=0x7f3e3c06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.366+0000 7f3e439c4640 1 -- 172.21.15.113:0/1345319963 shutdown_connections 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.366+0000 7f3e439c4640 1 -- 172.21.15.113:0/1345319963 wait complete. 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 Processor -- start 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 -- start start 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c06b7d0 0x7f3e3c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 0x7f3e3c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c06c360 con 0x7f3e3c161d20 2024-02-26T12:19:40.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1585c0 con 0x7f3e3c1581e0 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e439c4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c06c4e0 con 0x7f3e3c06b7d0 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.367+0000 7f3e41f61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47526/0 (socket says 172.21.15.113:47526) 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 -- 172.21.15.113:0/3836193142 learned_addr learned my addr 172.21.15.113:0/3836193142 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e40f5f640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 0x7f3e3c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41760640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c06b7d0 0x7f3e3c149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 -- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c06b7d0 msgr2=0x7f3e3c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c06b7d0 0x7f3e3c149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 -- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 msgr2=0x7f3e3c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 0x7f3e3c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 -- 172.21.15.113:0/3836193142 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c159220 con 0x7f3e3c161d20 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e40f5f640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 0x7f3e3c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:40.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e41f61640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400c7d0 tx=0x7f3e3400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34018070 con 0x7f3e3c161d20 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400a640 con 0x7f3e3c161d20 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c159500 con 0x7f3e3c161d20 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400aa30 con 0x7f3e3c161d20 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.368+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c15e7f0 con 0x7f3e3c161d20 2024-02-26T12:19:40.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.369+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c074a50 con 0x7f3e3c161d20 2024-02-26T12:19:40.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.370+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e3401b070 con 0x7f3e3c161d20 2024-02-26T12:19:40.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.370+0000 7f3e31ffb640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 0x7f3e2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.370+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e34089810 con 0x7f3e3c161d20 2024-02-26T12:19:40.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.370+0000 7f3e41760640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 0x7f3e2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.371+0000 7f3e41760640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 0x7f3e2006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e38006fd0 tx=0x7f3e38008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.359 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.374+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e34058690 con 0x7f3e3c161d20 2024-02-26T12:19:40.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.546+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e3c06be20 con 0x7f3e3c161d20 2024-02-26T12:19:40.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.547+0000 7f3e31ffb640 1 -- 172.21.15.113:0/3836193142 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e34057f90 con 0x7f3e3c161d20 2024-02-26T12:19:40.532 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:40.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.548+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 msgr2=0x7f3e2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.548+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 0x7f3e2006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e38006fd0 tx=0x7f3e38008040 comp rx=0 tx=0).stop 2024-02-26T12:19:40.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 msgr2=0x7f3e3c0ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400c7d0 tx=0x7f3e3400cc90 comp rx=0 tx=0).stop 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 shutdown_connections 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e2006b4d0 0x7f3e2006d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e3c161d20 0x7f3e3c0ceb60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e3c1581e0 0x7f3e3c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 --2- 172.21.15.113:0/3836193142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e3c06b7d0 0x7f3e3c149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 >> 172.21.15.113:0/3836193142 conn(0x7f3e3c06db80 msgr2=0x7f3e3c15fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 shutdown_connections 2024-02-26T12:19:40.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.549+0000 7f3e439c4640 1 -- 172.21.15.113:0/3836193142 wait complete. 2024-02-26T12:19:40.545 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:40.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.662+0000 7f18f42d1640 1 Processor -- start 2024-02-26T12:19:40.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.662+0000 7f18f42d1640 1 -- start start 2024-02-26T12:19:40.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f42d1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f18ec1581e0 0x7f18ec06be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f42d1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f42d1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec0b33f0 con 0x7f18ec161d20 2024-02-26T12:19:40.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f42d1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec0b36d0 con 0x7f18ec1581e0 2024-02-26T12:19:40.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f42d1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0b39b0 con 0x7f18ec06b7d0 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f206d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f18ec1581e0 0x7f18ec06be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f186c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f286e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f18ec161d20 0x7f18ec15e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47258/0 (socket says 172.21.15.113:47258) 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f186c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:49450/0 (socket says 172.21.15.113:49450) 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f206d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f18ec1581e0 0x7f18ec06be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:44300/0 (socket says 172.21.15.113:44300) 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.663+0000 7f18f186c640 1 -- 172.21.15.113:0/413982146 learned_addr learned my addr 172.21.15.113:0/413982146 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f206d640 1 -- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 msgr2=0x7f18ec1617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f206d640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f206d640 1 -- 172.21.15.113:0/413982146 >> v1:172.21.15.152:6789/0 conn(0x7f18ec161d20 legacy=0x7f18ec15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f206d640 1 -- 172.21.15.113:0/413982146 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec0b3c90 con 0x7f18ec1581e0 2024-02-26T12:19:40.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f186c640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:40.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f206d640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec1581e0 0x7f18ec06be20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097a0 tx=0x7f18e402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254b7a206753edf server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.664+0000 7f18f106b640 1 -- 172.21.15.113:0/413982146 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40315a0 con 0x7f18ec1581e0 2024-02-26T12:19:40.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f106b640 1 -- 172.21.15.113:0/413982146 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4037070 con 0x7f18ec1581e0 2024-02-26T12:19:40.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f106b640 1 -- 172.21.15.113:0/413982146 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4031960 con 0x7f18ec1581e0 2024-02-26T12:19:40.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 -- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec1581e0 msgr2=0x7f18ec06be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec1581e0 0x7f18ec06be20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18e40097a0 tx=0x7f18e402b840 comp rx=0 tx=0).stop 2024-02-26T12:19:40.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 -- 172.21.15.113:0/413982146 shutdown_connections 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 --2- 172.21.15.113:0/413982146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec1581e0 0x7f18ec06be20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 -- 172.21.15.113:0/413982146 >> 172.21.15.113:0/413982146 conn(0x7f18ec06db80 msgr2=0x7f18ec06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 -- 172.21.15.113:0/413982146 shutdown_connections 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.665+0000 7f18f42d1640 1 -- 172.21.15.113:0/413982146 wait complete. 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.666+0000 7f18f42d1640 1 Processor -- start 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.666+0000 7f18f42d1640 1 -- start start 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec161d20 0x7f18ec0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec06c360 con 0x7f18ec1581e0 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1585c0 con 0x7f18ec161d20 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f42d1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec06c4e0 con 0x7f18ec06b7d0 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47536/0 (socket says 172.21.15.113:47536) 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 -- 172.21.15.113:0/71499776 learned_addr learned my addr 172.21.15.113:0/71499776 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f206d640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f286e640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec161d20 0x7f18ec0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 -- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 msgr2=0x7f18ec1f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 -- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec161d20 msgr2=0x7f18ec0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec161d20 0x7f18ec0cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.667+0000 7f18f186c640 1 -- 172.21.15.113:0/71499776 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec1f6db0 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18f186c640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e9e0 tx=0x7f18e000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0017070 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000c9d0 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec1f7090 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000cd80 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.668+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec1f3890 con 0x7f18ec1581e0 2024-02-26T12:19:40.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.669+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec074a50 con 0x7f18ec1581e0 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.669+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18e001a070 con 0x7f18ec1581e0 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.669+0000 7f18eaffd640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 0x7f18d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.670+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e008a440 con 0x7f18ec1581e0 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.670+0000 7f18f206d640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 0x7f18d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.670+0000 7f18f206d640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 0x7f18d806d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18e4036000 tx=0x7f18e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.674+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18e00592c0 con 0x7f18ec1581e0 2024-02-26T12:19:40.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.843+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18ec06e4b0 con 0x7f18ec1581e0 2024-02-26T12:19:40.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.844+0000 7f18eaffd640 1 -- 172.21.15.113:0/71499776 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18e0058bc0 con 0x7f18ec1581e0 2024-02-26T12:19:40.829 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:40.831 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 msgr2=0x7f18d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 0x7f18d806d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f18e4036000 tx=0x7f18e4008030 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 msgr2=0x7f18ec0ced10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f18e000e9e0 tx=0x7f18e000eea0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 shutdown_connections 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f18d806b4d0 0x7f18d806d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18ec161d20 0x7f18ec0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18ec1581e0 0x7f18ec0ced10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 --2- 172.21.15.113:0/71499776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18ec06b7d0 0x7f18ec1f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 >> 172.21.15.113:0/71499776 conn(0x7f18ec06db80 msgr2=0x7f18ec162130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 shutdown_connections 2024-02-26T12:19:40.832 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.846+0000 7f18f42d1640 1 -- 172.21.15.113:0/71499776 wait complete. 2024-02-26T12:19:40.842 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:40.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.957+0000 7ff1a8fcc640 1 Processor -- start 2024-02-26T12:19:40.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.957+0000 7ff1a8fcc640 1 -- start start 2024-02-26T12:19:40.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a40711f0 0x7ff1a40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff1a4071b10 0x7ff1a40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff1a40cee60 0x7ff1a406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a4145840 con 0x7ff1a4071b10 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40cf670 con 0x7ff1a40cee60 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a8fcc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40cf950 con 0x7ff1a40711f0 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff1a4071b10 0x7ff1a40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff1a4071b10 0x7ff1a40ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47538/0 (socket says 172.21.15.113:47538) 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 -- 172.21.15.113:0/1491131715 learned_addr learned my addr 172.21.15.113:0/1491131715 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 -- 172.21.15.113:0/1491131715 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a40711f0 msgr2=0x7ff1a40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/1491131715 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a40711f0 0x7ff1a40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 -- 172.21.15.113:0/1491131715 >> v2:172.21.15.152:3300/0 conn(0x7ff1a40cee60 msgr2=0x7ff1a406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/1491131715 >> v2:172.21.15.152:3300/0 conn(0x7ff1a40cee60 0x7ff1a406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.958+0000 7ff1a1d9b640 1 -- 172.21.15.113:0/1491131715 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40cfc30 con 0x7ff1a4071b10 2024-02-26T12:19:40.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/1491131715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a4071b10 0x7ff1a40ce920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40cfb60 tx=0x7ff19402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e2c850f611ae44 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a159a640 1 -- 172.21.15.113:0/1491131715 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194035020 con 0x7ff1a4071b10 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a159a640 1 -- 172.21.15.113:0/1491131715 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194031640 con 0x7ff1a4071b10 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a159a640 1 -- 172.21.15.113:0/1491131715 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19402d040 con 0x7ff1a4071b10 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/1491131715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a4071b10 msgr2=0x7ff1a40ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/1491131715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a4071b10 0x7ff1a40ce920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40cfb60 tx=0x7ff19402b8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/1491131715 shutdown_connections 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/1491131715 >> v2:172.21.15.152:3300/0 conn(0x7ff1a40cee60 0x7ff1a406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/1491131715 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a4071b10 0x7ff1a40ce920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/1491131715 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a40711f0 0x7ff1a40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/1491131715 >> 172.21.15.113:0/1491131715 conn(0x7ff1a406ab50 msgr2=0x7ff1a406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.959+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/1491131715 shutdown_connections 2024-02-26T12:19:40.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.960+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/1491131715 wait complete. 2024-02-26T12:19:40.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 Processor -- start 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 -- start start 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4071b10 0x7ff1a415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a40cee60 0x7ff1a415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40cf290 con 0x7ff1a40711f0 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4071f90 con 0x7ff1a40cee60 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.961+0000 7ff1a8fcc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40cf410 con 0x7ff1a4071b10 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47544/0 (socket says 172.21.15.113:47544) 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 -- 172.21.15.113:0/412750963 learned_addr learned my addr 172.21.15.113:0/412750963 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a2d9d640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a40cee60 0x7ff1a415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4071b10 0x7ff1a415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 -- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4071b10 msgr2=0x7ff1a415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4071b10 0x7ff1a415d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 -- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a40cee60 msgr2=0x7ff1a415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a40cee60 0x7ff1a415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 -- 172.21.15.113:0/412750963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4131f60 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a259c640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b4a0 tx=0x7ff19800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198014070 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198010610 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198010a00 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a41f5180 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.962+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a41f5740 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.963+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a4074a50 con 0x7ff1a40711f0 2024-02-26T12:19:40.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.964+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff198017070 con 0x7ff1a40711f0 2024-02-26T12:19:40.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.964+0000 7ff192ffd640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 0x7ff18406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:40.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.964+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff198089b00 con 0x7ff1a40711f0 2024-02-26T12:19:40.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.964+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 0x7ff18406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:40.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.964+0000 7ff1a1d9b640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 0x7ff18406d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff194036000 tx=0x7ff19403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:40.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:40.968+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff1980583c0 con 0x7ff1a40711f0 2024-02-26T12:19:41.125 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.140+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a40c7890 con 0x7ff1a40711f0 2024-02-26T12:19:41.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.141+0000 7ff192ffd640 1 -- 172.21.15.113:0/412750963 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7ff19805c460 con 0x7ff1a40711f0 2024-02-26T12:19:41.126 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:41.127 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 msgr2=0x7ff18406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 0x7ff18406d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff194036000 tx=0x7ff19403c040 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 msgr2=0x7ff1a40ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b4a0 tx=0x7ff19800b960 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 shutdown_connections 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff18406b4d0 0x7ff18406d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a40cee60 0x7ff1a415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4071b10 0x7ff1a415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 --2- 172.21.15.113:0/412750963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1a40711f0 0x7ff1a40ca070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 >> 172.21.15.113:0/412750963 conn(0x7ff1a406ab50 msgr2=0x7ff1a41417c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 shutdown_connections 2024-02-26T12:19:41.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.143+0000 7ff1a8fcc640 1 -- 172.21.15.113:0/412750963 wait complete. 2024-02-26T12:19:41.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:41.140 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:41.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.258+0000 7f92a5511640 1 Processor -- start 2024-02-26T12:19:41.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.258+0000 7f92a5511640 1 -- start start 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f92a5511640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f92a015de30 0x7f92a00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f92a5511640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00d1dc0 con 0x7f92a00b5b50 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f92a5511640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a00cf000 con 0x7f92a00ceb00 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f92a5511640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a0161d50 con 0x7f92a015de30 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929effd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f92a015de30 0x7f92a00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929e7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f92a00b5b50 0x7f92a00ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48796/0 (socket says 172.21.15.113:48796) 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929e7fc640 1 -- 172.21.15.113:0/2285993898 learned_addr learned my addr 172.21.15.113:0/2285993898 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929effd640 1 -- 172.21.15.113:0/2285993898 >> v1:172.21.15.152:6789/0 conn(0x7f92a00ceb00 legacy=0x7f92a00d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929effd640 1 -- 172.21.15.113:0/2285993898 >> v1:172.21.15.113:6789/0 conn(0x7f92a00b5b50 legacy=0x7f92a00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929effd640 1 -- 172.21.15.113:0/2285993898 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00d2060 con 0x7f92a015de30 2024-02-26T12:19:41.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.259+0000 7f929dffb640 1 -- 172.21.15.113:0/2285993898 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166255228 0 0) 0x7f92a00d1dc0 con 0x7f92a00b5b50 2024-02-26T12:19:41.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.260+0000 7f929effd640 1 --2- 172.21.15.113:0/2285993898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a00b5610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92900097a0 tx=0x7f929002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288743b0eebdd109 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.246 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.260+0000 7f929dffb640 1 -- 172.21.15.113:0/2285993898 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290034070 con 0x7f92a015de30 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.260+0000 7f929dffb640 1 -- 172.21.15.113:0/2285993898 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290030610 con 0x7f92a015de30 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.260+0000 7f929dffb640 1 -- 172.21.15.113:0/2285993898 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92900309e0 con 0x7f92a015de30 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 -- 172.21.15.113:0/2285993898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 msgr2=0x7f92a00b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 --2- 172.21.15.113:0/2285993898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a00b5610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92900097a0 tx=0x7f929002b960 comp rx=0 tx=0).stop 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 -- 172.21.15.113:0/2285993898 shutdown_connections 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 --2- 172.21.15.113:0/2285993898 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a00b5610 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 -- 172.21.15.113:0/2285993898 >> 172.21.15.113:0/2285993898 conn(0x7f92a00d0610 msgr2=0x7f92a00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 -- 172.21.15.113:0/2285993898 shutdown_connections 2024-02-26T12:19:41.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.261+0000 7f92a5511640 1 -- 172.21.15.113:0/2285993898 wait complete. 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.262+0000 7f92a5511640 1 Processor -- start 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.262+0000 7f92a5511640 1 -- start start 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 0x7f92a0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 0x7f92a0160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a015e210 con 0x7f92a015de30 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00b6dc0 con 0x7f92a00ceb00 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00cf2e0 con 0x7f92a00b5b50 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47574/0 (socket says 172.21.15.113:47574) 2024-02-26T12:19:41.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 -- 172.21.15.113:0/686754160 learned_addr learned my addr 172.21.15.113:0/686754160 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929e7fc640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 0x7f92a0160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929effd640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 0x7f92a0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 -- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 msgr2=0x7f92a0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 0x7f92a0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 -- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 msgr2=0x7f92a0160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 0x7f92a0160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 -- 172.21.15.113:0/686754160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a01f3be0 con 0x7f92a015de30 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929e7fc640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 0x7f92a0160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929effd640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 0x7f92a0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f929f7fe640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f929800c760 tx=0x7f929800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298003b70 con 0x7f92a015de30 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9298003d10 con 0x7f92a015de30 2024-02-26T12:19:41.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929800aa90 con 0x7f92a015de30 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.263+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a00cda20 con 0x7f92a015de30 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.264+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0154170 con 0x7f92a015de30 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.265+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0074a50 con 0x7f92a015de30 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.265+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f929800ac30 con 0x7f92a015de30 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.265+0000 7f92877fe640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 0x7f928c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.265+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f929808a070 con 0x7f92a015de30 2024-02-26T12:19:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.265+0000 7f929effd640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 0x7f928c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.266+0000 7f929effd640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 0x7f928c06d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9290036000 tx=0x7f929003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.270+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9298058f80 con 0x7f92a015de30 2024-02-26T12:19:41.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.440+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92a00d18d0 con 0x7f92a015de30 2024-02-26T12:19:41.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.440+0000 7f92877fe640 1 -- 172.21.15.113:0/686754160 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9298058880 con 0x7f92a015de30 2024-02-26T12:19:41.426 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:41.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 msgr2=0x7f928c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 0x7f928c06d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9290036000 tx=0x7f929003b040 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 msgr2=0x7f92a01f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f929800c760 tx=0x7f929800cc20 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 shutdown_connections 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f928c06b4d0 0x7f928c06d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f92a015de30 0x7f92a01f43a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92a00ceb00 0x7f92a0160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 --2- 172.21.15.113:0/686754160 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92a00b5b50 0x7f92a0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 >> 172.21.15.113:0/686754160 conn(0x7f92a00d0610 msgr2=0x7f92a00b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 shutdown_connections 2024-02-26T12:19:41.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.442+0000 7f92a5511640 1 -- 172.21.15.113:0/686754160 wait complete. 2024-02-26T12:19:41.438 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:41.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.557+0000 7f6518836640 1 Processor -- start 2024-02-26T12:19:41.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.557+0000 7f6518836640 1 -- start start 2024-02-26T12:19:41.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f6518836640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f65140b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f6518836640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140ced10 con 0x7f651415bbf0 2024-02-26T12:19:41.545 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f6518836640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140b2890 con 0x7f651406ddb0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f6518836640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140cefb0 con 0x7f6514071a50 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f651259c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f651415bbf0 0x7f6514071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48808/0 (socket says 172.21.15.113:48808) 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.558+0000 7f651259c640 1 -- 172.21.15.113:0/1718958297 learned_addr learned my addr 172.21.15.113:0/1718958297 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6511d9b640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f65140b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481114511 0 0) 0x7f65140ced10 con 0x7f651415bbf0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64fc003520 con 0x7f651415bbf0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293505068 0 0) 0x7f64fc003520 con 0x7f651415bbf0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 msgr2=0x7f65140b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f65140b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 >> v1:172.21.15.152:6789/0 conn(0x7f651406ddb0 legacy=0x7f65140b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140cf290 con 0x7f651415bbf0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f65040019f0 con 0x7f651415bbf0 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 >> v1:172.21.15.113:6789/0 conn(0x7f651415bbf0 legacy=0x7f6514071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f64fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64fc004d40 0x7f64fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140cefb0 con 0x7f64fc004d40 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc00bb30 con 0x7f64fc0039e0 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc00bd30 con 0x7f6514071a50 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64fc004d40 0x7f64fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f651259c640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6511d9b640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f64fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 -- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 msgr2=0x7f64fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f64fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 -- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64fc0039e0 msgr2=0x7f64fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6512d9d640 1 -- 172.21.15.113:0/1718958297 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc003520 con 0x7f64fc004d40 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.559+0000 7f6511d9b640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6514071a50 0x7f64fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.560+0000 7f6512d9d640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64fc004d40 0x7f64fc0051c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f650c001720 tx=0x7f64fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de609e5638f77d19 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.560+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c001370 con 0x7f64fc004d40 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.560+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0052d0 con 0x7f64fc004d40 2024-02-26T12:19:41.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.560+0000 7f651159a640 1 -- 172.21.15.113:0/1718958297 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c003830 con 0x7f64fc004d40 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 -- 172.21.15.113:0/1718958297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64fc004d40 msgr2=0x7f64fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 --2- 172.21.15.113:0/1718958297 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f64fc004d40 0x7f64fc0051c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f650c001720 tx=0x7f64fc005830 comp rx=0 tx=0).stop 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6512d9d640 1 -- 172.21.15.113:0/1718958297 reap_dead start 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 -- 172.21.15.113:0/1718958297 shutdown_connections 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 -- 172.21.15.113:0/1718958297 >> 172.21.15.113:0/1718958297 conn(0x7f65140cc100 msgr2=0x7f65140cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 -- 172.21.15.113:0/1718958297 shutdown_connections 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.561+0000 7f6518836640 1 -- 172.21.15.113:0/1718958297 wait complete. 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.562+0000 7f6518836640 1 Processor -- start 2024-02-26T12:19:41.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.562+0000 7f6518836640 1 -- start start 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64fc004d40 0x7f65141545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6514147560 0x7f651415e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651415bfd0 con 0x7f651415d370 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140720f0 con 0x7f6514147560 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651415c150 con 0x7f64fc004d40 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47594/0 (socket says 172.21.15.113:47594) 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 -- 172.21.15.113:0/571308204 learned_addr learned my addr 172.21.15.113:0/571308204 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6511d9b640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6514147560 0x7f651415e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f651259c640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64fc004d40 0x7f65141545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 -- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64fc004d40 msgr2=0x7f65141545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64fc004d40 0x7f65141545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 -- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6514147560 msgr2=0x7f651415e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6514147560 0x7f651415e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 -- 172.21.15.113:0/571308204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514144a20 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6512d9d640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f650c02bcb0 tx=0x7f650c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c001370 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c044070 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6514144ce0 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.563+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c007a30 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.564+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65141452a0 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.564+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6514074a50 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.565+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f650c03b040 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.565+0000 7f6502ffd640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 0x7f64f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.565+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f650c0ab570 con 0x7f651415d370 2024-02-26T12:19:41.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.565+0000 7f651259c640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 0x7f64f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.566+0000 7f651259c640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 0x7f64f406d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504004d00 tx=0x7f6504006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.570+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f650c079da0 con 0x7f651415d370 2024-02-26T12:19:41.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.737+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65140b5460 con 0x7f651415d370 2024-02-26T12:19:41.723 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.738+0000 7f6502ffd640 1 -- 172.21.15.113:0/571308204 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f650c0800f0 con 0x7f651415d370 2024-02-26T12:19:41.723 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 msgr2=0x7f64f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 0x7f64f406d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6504004d00 tx=0x7f6504006040 comp rx=0 tx=0).stop 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 msgr2=0x7f651415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f650c02bcb0 tx=0x7f650c001120 comp rx=0 tx=0).stop 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 shutdown_connections 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f64f406b4d0 0x7f64f406d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f651415d370 0x7f651415d7f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6514147560 0x7f651415e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.725 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 --2- 172.21.15.113:0/571308204 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64fc004d40 0x7f65141545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.739+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 >> 172.21.15.113:0/571308204 conn(0x7f65140cc100 msgr2=0x7f65140b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.740+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 shutdown_connections 2024-02-26T12:19:41.726 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.740+0000 7f6518836640 1 -- 172.21.15.113:0/571308204 wait complete. 2024-02-26T12:19:41.736 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:41.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.853+0000 7ffb0411e640 1 Processor -- start 2024-02-26T12:19:41.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.854+0000 7ffb0411e640 1 -- start start 2024-02-26T12:19:41.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.854+0000 7ffb0411e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffafc15af30 0x7ffafc06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb0411e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb0411e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc15b430 con 0x7ffafc154eb0 2024-02-26T12:19:41.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb0411e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc0ce360 con 0x7ffafc15af30 2024-02-26T12:19:41.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb0411e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc15b710 con 0x7ffafc0cb3b0 2024-02-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffafc15af30 0x7ffafc06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb026bb640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb01eba640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ffafc154eb0 0x7ffafc071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47276/0 (socket says 172.21.15.113:47276) 2024-02-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffafc15af30 0x7ffafc06f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:44346/0 (socket says 172.21.15.113:44346) 2024-02-26T12:19:41.842 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb01eba640 1 -- 172.21.15.113:0/938616237 learned_addr learned my addr 172.21.15.113:0/938616237 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb00eb8640 1 -- 172.21.15.113:0/938616237 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091226684 0 0) 0x7ffafc15b430 con 0x7ffafc154eb0 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb00eb8640 1 -- 172.21.15.113:0/938616237 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae8005730 con 0x7ffafc154eb0 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 -- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 msgr2=0x7ffafc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc0cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 -- 172.21.15.113:0/938616237 >> v1:172.21.15.152:6789/0 conn(0x7ffafc154eb0 legacy=0x7ffafc071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb016b9640 1 -- 172.21.15.113:0/938616237 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc15b9f0 con 0x7ffafc15af30 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.855+0000 7ffb026bb640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.856+0000 7ffb016b9640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc15af30 0x7ffafc06f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0097a0 tx=0x7ffaec02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f305f9f4cea66b3d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.856+0000 7ffb00eb8640 1 -- 172.21.15.113:0/938616237 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0315a0 con 0x7ffafc15af30 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.856+0000 7ffb00eb8640 1 -- 172.21.15.113:0/938616237 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec037070 con 0x7ffafc15af30 2024-02-26T12:19:41.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.856+0000 7ffb00eb8640 1 -- 172.21.15.113:0/938616237 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec031940 con 0x7ffafc15af30 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 -- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc15af30 msgr2=0x7ffafc06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc15af30 0x7ffafc06f2b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0097a0 tx=0x7ffaec02b840 comp rx=0 tx=0).stop 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 -- 172.21.15.113:0/938616237 shutdown_connections 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 --2- 172.21.15.113:0/938616237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc15af30 0x7ffafc06f2b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 -- 172.21.15.113:0/938616237 >> 172.21.15.113:0/938616237 conn(0x7ffafc0cc100 msgr2=0x7ffafc0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 -- 172.21.15.113:0/938616237 shutdown_connections 2024-02-26T12:19:41.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.857+0000 7ffb0411e640 1 -- 172.21.15.113:0/938616237 wait complete. 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.858+0000 7ffb0411e640 1 Processor -- start 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.858+0000 7ffb0411e640 1 -- start start 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc154eb0 0x7ffafc0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0ccf60 con 0x7ffafc15af30 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0ccde0 con 0x7ffafc154eb0 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb0411e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc155290 con 0x7ffafc0cb3b0 2024-02-26T12:19:41.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47602/0 (socket says 172.21.15.113:47602) 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 -- 172.21.15.113:0/4099672358 learned_addr learned my addr 172.21.15.113:0/4099672358 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb016b9640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc154eb0 0x7ffafc0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb01eba640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 -- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 msgr2=0x7ffafc152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 -- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc154eb0 msgr2=0x7ffafc0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc154eb0 0x7ffafc0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:41.848 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 -- 172.21.15.113:0/4099672358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc14e500 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffb026bb640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400efc0 tx=0x7ffaf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.859+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4018030 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.860+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf400cdf0 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.860+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4003bb0 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.860+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc14e7e0 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.860+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc14eda0 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.860+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc074a50 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.861+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffaf401b070 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.861+0000 7ffaf27fc640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.861+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaf408ab20 con 0x7ffafc15af30 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.861+0000 7ffb01eba640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:41.849 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.862+0000 7ffb01eba640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 0x7ffae006d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005880 tx=0x7ffaf8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:41.851 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:41.866+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffaf4010040 con 0x7ffafc15af30 2024-02-26T12:19:42.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.035+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffafc15e240 con 0x7ffafc15af30 2024-02-26T12:19:42.021 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.036+0000 7ffaf27fc640 1 -- 172.21.15.113:0/4099672358 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffaf40592d0 con 0x7ffafc15af30 2024-02-26T12:19:42.021 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:42.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 msgr2=0x7ffae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 0x7ffae006d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8005880 tx=0x7ffaf8009040 comp rx=0 tx=0).stop 2024-02-26T12:19:42.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 msgr2=0x7ffafc14f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400efc0 tx=0x7ffaf400c490 comp rx=0 tx=0).stop 2024-02-26T12:19:42.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 shutdown_connections 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffae006b4d0 0x7ffae006d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffafc15af30 0x7ffafc14f5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffafc154eb0 0x7ffafc0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 --2- 172.21.15.113:0/4099672358 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffafc0cb3b0 0x7ffafc152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.037+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 >> 172.21.15.113:0/4099672358 conn(0x7ffafc0cc100 msgr2=0x7ffafc15c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.038+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 shutdown_connections 2024-02-26T12:19:42.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.038+0000 7ffb0411e640 1 -- 172.21.15.113:0/4099672358 wait complete. 2024-02-26T12:19:42.034 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:42.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 Processor -- start 2024-02-26T12:19:42.133 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 -- start start 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f491c15def0 0x7f491c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0d1f50 con 0x7f491c0ce8b0 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0d2230 con 0x7f491c0b2d80 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f4922b1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0d2510 con 0x7f491c15def0 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.148+0000 7f49208ba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f491c15def0 0x7f491c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49210bb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f491c0ce8b0 0x7f491c0b6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48818/0 (socket says 172.21.15.113:48818) 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49210bb640 1 -- 172.21.15.113:0/3917122168 learned_addr learned my addr 172.21.15.113:0/3917122168 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49208ba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f491c15def0 0x7f491c0b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47610/0 (socket says 172.21.15.113:47610) 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49208ba640 1 -- 172.21.15.113:0/3917122168 >> v1:172.21.15.152:6789/0 conn(0x7f491c0b2d80 legacy=0x7f491c0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49208ba640 1 -- 172.21.15.113:0/3917122168 >> v1:172.21.15.113:6789/0 conn(0x7f491c0ce8b0 legacy=0x7f491c0b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49208ba640 1 -- 172.21.15.113:0/3917122168 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0d27f0 con 0x7f491c15def0 2024-02-26T12:19:42.135 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f491b7fe640 1 -- 172.21.15.113:0/3917122168 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321572112 0 0) 0x7f491c0d1f50 con 0x7f491c0ce8b0 2024-02-26T12:19:42.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.149+0000 7f49208ba640 1 --2- 172.21.15.113:0/3917122168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c15def0 0x7f491c0b9400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4914009dc0 tx=0x7f491402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcccf627f5397502 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f491b7fe640 1 -- 172.21.15.113:0/3917122168 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914039070 con 0x7f491c15def0 2024-02-26T12:19:42.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f491b7fe640 1 -- 172.21.15.113:0/3917122168 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491402ccd0 con 0x7f491c15def0 2024-02-26T12:19:42.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f491b7fe640 1 -- 172.21.15.113:0/3917122168 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914034660 con 0x7f491c15def0 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 -- 172.21.15.113:0/3917122168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c15def0 msgr2=0x7f491c0b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3917122168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c15def0 0x7f491c0b9400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4914009dc0 tx=0x7f491402bf20 comp rx=0 tx=0).stop 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 -- 172.21.15.113:0/3917122168 shutdown_connections 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3917122168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c15def0 0x7f491c0b9400 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 -- 172.21.15.113:0/3917122168 >> 172.21.15.113:0/3917122168 conn(0x7f491c0728b0 msgr2=0x7f491c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 -- 172.21.15.113:0/3917122168 shutdown_connections 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.150+0000 7f4922b1e640 1 -- 172.21.15.113:0/3917122168 wait complete. 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.151+0000 7f4922b1e640 1 Processor -- start 2024-02-26T12:19:42.137 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.151+0000 7f4922b1e640 1 -- start start 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f491c0ce8b0 0x7f491c1f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f491c0d3a70 0x7f491c0d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b9940 con 0x7f491c0b2d80 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0d3700 con 0x7f491c0ce8b0 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f4922b1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0b9ac0 con 0x7f491c0d3a70 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f49208ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f49208ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47620/0 (socket says 172.21.15.113:47620) 2024-02-26T12:19:42.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.152+0000 7f49208ba640 1 -- 172.21.15.113:0/3354651018 learned_addr learned my addr 172.21.15.113:0/3354651018 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 -- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f491c0d3a70 msgr2=0x7f491c0d3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f491c0d3a70 0x7f491c0d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 -- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f491c0ce8b0 msgr2=0x7f491c1f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f491c0ce8b0 0x7f491c1f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 -- 172.21.15.113:0/3354651018 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c1f35b0 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49208ba640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4914000f80 tx=0x7f4914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914039050 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914045070 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491403ea70 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c1f7350 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.153+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c1f7910 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.154+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c074a50 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.154+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f491402cb90 con 0x7f491c0b2d80 2024-02-26T12:19:42.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.155+0000 7f49197fa640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 0x7f48fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.155+0000 7f491bfff640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 0x7f48fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.155+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49140ad0e0 con 0x7f491c0b2d80 2024-02-26T12:19:42.142 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.155+0000 7f491bfff640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 0x7f48fc06d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4904000f60 tx=0x7f49040079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.159+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4914032e20 con 0x7f491c0b2d80 2024-02-26T12:19:42.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.332+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f491c0b9490 con 0x7f491c0b2d80 2024-02-26T12:19:42.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.333+0000 7f49197fa640 1 -- 172.21.15.113:0/3354651018 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f491407c080 con 0x7f491c0b2d80 2024-02-26T12:19:42.319 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:42.319 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 msgr2=0x7f48fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 0x7f48fc06d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4904000f60 tx=0x7f49040079b0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 msgr2=0x7f491c1f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4914000f80 tx=0x7f4914004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 shutdown_connections 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f48fc06b500 0x7f48fc06d9c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f491c0d3a70 0x7f491c0d3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f491c0ce8b0 0x7f491c1f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 --2- 172.21.15.113:0/3354651018 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f491c0b2d80 0x7f491c1f6a90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 >> 172.21.15.113:0/3354651018 conn(0x7f491c0728b0 msgr2=0x7f491c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.321 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 shutdown_connections 2024-02-26T12:19:42.322 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.335+0000 7f4922b1e640 1 -- 172.21.15.113:0/3354651018 wait complete. 2024-02-26T12:19:42.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:42.332 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.451+0000 7f676ba76640 1 Processor -- start 2024-02-26T12:19:42.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.451+0000 7f676ba76640 1 -- start start 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676ba76640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f676406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676ba76640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67640cb3b0 0x7f67640cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676ba76640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676415b430 con 0x7f6764154eb0 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676ba76640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640ce360 con 0x7f67640cb3b0 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676ba76640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676415b710 con 0x7f676415af30 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6769812640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6764154eb0 0x7f6764071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48832/0 (socket says 172.21.15.113:48832) 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6769812640 1 -- 172.21.15.113:0/3400383931 learned_addr learned my addr 172.21.15.113:0/3400383931 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f676a013640 1 --2- 172.21.15.113:0/3400383931 >> v2:172.21.15.152:3300/0 conn(0x7f67640cb3b0 0x7f67640cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6769011640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f676406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489186887 0 0) 0x7f676415b430 con 0x7f6764154eb0 2024-02-26T12:19:42.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6750005730 con 0x7f6764154eb0 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439500925 0 0) 0x7f6750005730 con 0x7f6764154eb0 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 msgr2=0x7f676406f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f676406f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 >> v2:172.21.15.152:3300/0 conn(0x7f67640cb3b0 msgr2=0x7f67640cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 --2- 172.21.15.113:0/3400383931 >> v2:172.21.15.152:3300/0 conn(0x7f67640cb3b0 0x7f67640cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676415b9f0 con 0x7f6764154eb0 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f6758001670 con 0x7f6764154eb0 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 >> v1:172.21.15.113:6789/0 conn(0x7f6764154eb0 legacy=0x7f6764071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6750005bc0 0x7f6750005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750006a10 0x7f6750006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f67500073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640ce360 con 0x7f6750005bc0 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676415b710 con 0x7f6750006a10 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675000dc00 con 0x7f676415af30 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.452+0000 7f6769812640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6750005bc0 0x7f6750005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769011640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750006a10 0x7f6750006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f676a013640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f67500073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 -- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 msgr2=0x7f67500073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f67500073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 -- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750006a10 msgr2=0x7f6750006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750006a10 0x7f6750006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 -- 172.21.15.113:0/3400383931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750005730 con 0x7f6750005bc0 2024-02-26T12:19:42.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f676a013640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f676415af30 0x7f67500073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.453+0000 7f6769812640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6750005bc0 0x7f6750005fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6758007fd0 tx=0x7f6750007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340ae1029c4a0ae7 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758007d50 con 0x7f6750005bc0 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758030070 con 0x7f6750005bc0 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f6768810640 1 -- 172.21.15.113:0/3400383931 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675802cd20 con 0x7f6750005bc0 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 -- 172.21.15.113:0/3400383931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6750005bc0 msgr2=0x7f6750005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 --2- 172.21.15.113:0/3400383931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6750005bc0 0x7f6750005fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6758007fd0 tx=0x7f6750007a40 comp rx=0 tx=0).stop 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676a013640 1 -- 172.21.15.113:0/3400383931 reap_dead start 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 -- 172.21.15.113:0/3400383931 shutdown_connections 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 -- 172.21.15.113:0/3400383931 >> 172.21.15.113:0/3400383931 conn(0x7f67640cc100 msgr2=0x7f67640cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 -- 172.21.15.113:0/3400383931 shutdown_connections 2024-02-26T12:19:42.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.454+0000 7f676ba76640 1 -- 172.21.15.113:0/3400383931 wait complete. 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.455+0000 7f676ba76640 1 Processor -- start 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 -- start start 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750005bc0 0x7f67640c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67640b0c30 0x7f676414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640ccf60 con 0x7f67640b3fd0 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640ccde0 con 0x7f6750005bc0 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676ba76640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764155290 con 0x7f67640b0c30 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676a013640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676a013640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47638/0 (socket says 172.21.15.113:47638) 2024-02-26T12:19:42.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f676a013640 1 -- 172.21.15.113:0/2575182141 learned_addr learned my addr 172.21.15.113:0/2575182141 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f6769812640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750005bc0 0x7f67640c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.456+0000 7f6769011640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67640b0c30 0x7f676414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 -- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67640b0c30 msgr2=0x7f676414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67640b0c30 0x7f676414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 -- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750005bc0 msgr2=0x7f67640c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750005bc0 0x7f67640c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 -- 172.21.15.113:0/2575182141 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640c4c50 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676a013640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67640c9c80 tx=0x7f675c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c010e30 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c003990 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640b34f0 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c003dc0 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.457+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640b3ab0 con 0x7f67640b3fd0 2024-02-26T12:19:42.447 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.458+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640b1170 con 0x7f67640b3fd0 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.458+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f675c01e020 con 0x7f67640b3fd0 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.459+0000 7f67567fc640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 0x7f674806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.459+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f675c08a760 con 0x7f67640b3fd0 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.459+0000 7f6769812640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 0x7f674806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.459+0000 7f6769812640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 0x7f674806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6758034000 tx=0x7f6758007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.448 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.463+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67640b1170 con 0x7f67640b3fd0 2024-02-26T12:19:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.632+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67640b3cb0 con 0x7f67640b3fd0 2024-02-26T12:19:42.618 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.633+0000 7f67567fc640 1 -- 172.21.15.113:0/2575182141 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67640b3cb0 con 0x7f67640b3fd0 2024-02-26T12:19:42.618 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 msgr2=0x7f674806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 0x7f674806d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6758034000 tx=0x7f6758007000 comp rx=0 tx=0).stop 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 msgr2=0x7f67640af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67640c9c80 tx=0x7f675c010590 comp rx=0 tx=0).stop 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 shutdown_connections 2024-02-26T12:19:42.620 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f674806b4d0 0x7f674806d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f67640b3fd0 0x7f67640af860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67640b0c30 0x7f676414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 --2- 172.21.15.113:0/2575182141 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6750005bc0 0x7f67640c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 >> 172.21.15.113:0/2575182141 conn(0x7f67640cc100 msgr2=0x7f6764071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 shutdown_connections 2024-02-26T12:19:42.621 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.635+0000 7f676ba76640 1 -- 172.21.15.113:0/2575182141 wait complete. 2024-02-26T12:19:42.631 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:42.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.747+0000 7feebf5c4640 1 Processor -- start 2024-02-26T12:19:42.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.748+0000 7feebf5c4640 1 -- start start 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.748+0000 7feebf5c4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feeb806b260 0x7feeb80cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.748+0000 7feebf5c4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 0x7feeb80cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.748+0000 7feebf5c4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb806fa10 con 0x7feeb8161480 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebf5c4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb806fc80 con 0x7feeb806b260 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebf5c4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb806ff60 con 0x7feeb80cfa20 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feeb806b260 0x7feeb80cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7feeb806b260 0x7feeb80cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47646/0 (socket says 172.21.15.113:47646) 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 -- 172.21.15.113:0/958315848 learned_addr learned my addr 172.21.15.113:0/958315848 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:42.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebdb61640 1 --2- 172.21.15.113:0/958315848 >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 0x7feeb80cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 -- 172.21.15.113:0/958315848 >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 msgr2=0x7feeb80cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 --2- 172.21.15.113:0/958315848 >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 0x7feeb80cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 -- 172.21.15.113:0/958315848 >> v1:172.21.15.152:6789/0 conn(0x7feeb8161480 legacy=0x7feeb806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebcb5f640 1 -- 172.21.15.113:0/958315848 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8070240 con 0x7feeb806b260 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.749+0000 7feebdb61640 1 --2- 172.21.15.113:0/958315848 >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 0x7feeb80cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebcb5f640 1 --2- 172.21.15.113:0/958315848 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80cae50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feeb809a150 tx=0x7feea802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf136c512c0dd53f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feeaffff640 1 -- 172.21.15.113:0/958315848 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8035020 con 0x7feeb806b260 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feeaffff640 1 -- 172.21.15.113:0/958315848 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8031870 con 0x7feeb806b260 2024-02-26T12:19:42.736 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feeaffff640 1 -- 172.21.15.113:0/958315848 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8031c40 con 0x7feeb806b260 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 -- 172.21.15.113:0/958315848 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 msgr2=0x7feeb80cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 --2- 172.21.15.113:0/958315848 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80cae50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feeb809a150 tx=0x7feea802b910 comp rx=0 tx=0).stop 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 -- 172.21.15.113:0/958315848 shutdown_connections 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 --2- 172.21.15.113:0/958315848 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80cae50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 --2- 172.21.15.113:0/958315848 >> v2:172.21.15.152:3300/0 conn(0x7feeb80cfa20 0x7feeb80cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.750+0000 7feebf5c4640 1 -- 172.21.15.113:0/958315848 >> 172.21.15.113:0/958315848 conn(0x7feeb8099a40 msgr2=0x7feeb80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.751+0000 7feebf5c4640 1 -- 172.21.15.113:0/958315848 shutdown_connections 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.751+0000 7feebf5c4640 1 -- 172.21.15.113:0/958315848 wait complete. 2024-02-26T12:19:42.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 Processor -- start 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 -- start start 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feeb80cfa20 0x7feeb814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feeb8161480 0x7feeb814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cd350 con 0x7feeb806b260 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80d0660 con 0x7feeb8161480 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.752+0000 7feebf5c4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cd4d0 con 0x7feeb80cfa20 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47652/0 (socket says 172.21.15.113:47652) 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 -- 172.21.15.113:0/3251659571 learned_addr learned my addr 172.21.15.113:0/3251659571 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebdb61640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feeb8161480 0x7feeb814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebcb5f640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feeb80cfa20 0x7feeb814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 -- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feeb80cfa20 msgr2=0x7feeb814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feeb80cfa20 0x7feeb814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 -- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feeb8161480 msgr2=0x7feeb814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feeb8161480 0x7feeb814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 -- 172.21.15.113:0/3251659571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb815ff50 con 0x7feeb806b260 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebd360640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feeb400b3f0 tx=0x7feeb400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4015020 con 0x7feeb806b260 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4011830 con 0x7feeb806b260 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb815eeb0 con 0x7feeb806b260 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4011c20 con 0x7feeb806b260 2024-02-26T12:19:42.741 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.753+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb815f470 con 0x7feeb806b260 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.754+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb8074a50 con 0x7feeb806b260 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.754+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feeb4018020 con 0x7feeb806b260 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.755+0000 7feeadffb640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 0x7fee9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.755+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb4089d70 con 0x7feeb806b260 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.755+0000 7feebcb5f640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 0x7fee9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:42.742 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.755+0000 7feebcb5f640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 0x7fee9c06d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feea8036000 tx=0x7feea803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:42.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.759+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feeb401f030 con 0x7feeb806b260 2024-02-26T12:19:42.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.928+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feeb8160ca0 con 0x7feeb806b260 2024-02-26T12:19:42.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.929+0000 7feeadffb640 1 -- 172.21.15.113:0/3251659571 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7feeb4058c80 con 0x7feeb806b260 2024-02-26T12:19:42.914 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:42.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 msgr2=0x7fee9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 0x7fee9c06d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feea8036000 tx=0x7feea803c040 comp rx=0 tx=0).stop 2024-02-26T12:19:42.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 msgr2=0x7feeb80c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feeb400b3f0 tx=0x7feeb400b8b0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 shutdown_connections 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fee9c06b4d0 0x7fee9c06d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feeb8161480 0x7feeb814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feeb80cfa20 0x7feeb814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 --2- 172.21.15.113:0/3251659571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feeb806b260 0x7feeb80c4520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 >> 172.21.15.113:0/3251659571 conn(0x7feeb8099a40 msgr2=0x7feeb80d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 shutdown_connections 2024-02-26T12:19:42.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:42.931+0000 7feebf5c4640 1 -- 172.21.15.113:0/3251659571 wait complete. 2024-02-26T12:19:42.927 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:43.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.045+0000 7f10e342d640 1 Processor -- start 2024-02-26T12:19:43.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.045+0000 7f10e342d640 1 -- start start 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e342d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e342d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f10dc06ddb0 0x7f10dc0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e342d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0ced10 con 0x7f10dc15bbf0 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e342d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b2890 con 0x7f10dc06ddb0 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e342d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0cefb0 con 0x7f10dc071a50 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e09c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f10dc06ddb0 0x7f10dc0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e11c9640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f10dc15bbf0 0x7f10dc071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47308/0 (socket says 172.21.15.113:47308) 2024-02-26T12:19:43.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e09c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.113:49584/0 (socket says 172.21.15.113:49584) 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e11c9640 1 -- 172.21.15.113:0/3231249401 learned_addr learned my addr 172.21.15.113:0/3231249401 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f10dc06ddb0 0x7f10dc0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:44422/0 (socket says 172.21.15.113:44422) 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 -- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 msgr2=0x7f10dc0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 -- 172.21.15.113:0/3231249401 >> v1:172.21.15.152:6789/0 conn(0x7f10dc15bbf0 legacy=0x7f10dc071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e19ca640 1 -- 172.21.15.113:0/3231249401 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0cf290 con 0x7f10dc06ddb0 2024-02-26T12:19:43.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.046+0000 7f10e09c8640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.047+0000 7f10e19ca640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc0b32b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b2b9f094cff49c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.047+0000 7f10d3fff640 1 -- 172.21.15.113:0/3231249401 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4039070 con 0x7f10dc06ddb0 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.047+0000 7f10d3fff640 1 -- 172.21.15.113:0/3231249401 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d402cce0 con 0x7f10dc06ddb0 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.047+0000 7f10d3fff640 1 -- 172.21.15.113:0/3231249401 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4034660 con 0x7f10dc06ddb0 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 -- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 msgr2=0x7f10dc0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc0b32b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d402bf30 comp rx=0 tx=0).stop 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 -- 172.21.15.113:0/3231249401 shutdown_connections 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc071a50 0x7f10dc0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 --2- 172.21.15.113:0/3231249401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc0b32b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 -- 172.21.15.113:0/3231249401 >> 172.21.15.113:0/3231249401 conn(0x7f10dc0cc100 msgr2=0x7f10dc0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 -- 172.21.15.113:0/3231249401 shutdown_connections 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.048+0000 7f10e342d640 1 -- 172.21.15.113:0/3231249401 wait complete. 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.049+0000 7f10e342d640 1 Processor -- start 2024-02-26T12:19:43.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.049+0000 7f10e342d640 1 -- start start 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc15bbf0 0x7f10dc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc15bfd0 con 0x7f10dc071a50 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0720f0 con 0x7f10dc06ddb0 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e342d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc15c150 con 0x7f10dc15bbf0 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47654/0 (socket says 172.21.15.113:47654) 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 -- 172.21.15.113:0/3677977713 learned_addr learned my addr 172.21.15.113:0/3677977713 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e11c9640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e19ca640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc15bbf0 0x7f10dc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.038 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 -- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc15bbf0 msgr2=0x7f10dc1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc15bbf0 0x7f10dc1533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 -- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 msgr2=0x7f10dc140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 -- 172.21.15.113:0/3677977713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc150440 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.050+0000 7f10e09c8640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00ebe0 tx=0x7f10cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.051+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc017070 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.051+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00cc30 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.051+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc1f2560 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.051+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc013470 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.051+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc152bd0 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.052+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc074a50 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.052+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10cc01a070 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.053+0000 7f10d1ffb640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 0x7f10c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.053+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10cc08a0e0 con 0x7f10dc071a50 2024-02-26T12:19:43.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.053+0000 7f10e11c9640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 0x7f10c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.053+0000 7f10e11c9640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 0x7f10c006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.057+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10cc058910 con 0x7f10dc071a50 2024-02-26T12:19:43.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.229+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10dc0b5460 con 0x7f10dc071a50 2024-02-26T12:19:43.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.229+0000 7f10d1ffb640 1 -- 172.21.15.113:0/3677977713 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10cc05c9b0 con 0x7f10dc071a50 2024-02-26T12:19:43.214 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:43.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 msgr2=0x7f10c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 0x7f10c006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8007e80 comp rx=0 tx=0).stop 2024-02-26T12:19:43.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 msgr2=0x7f10dc15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00ebe0 tx=0x7f10cc00c520 comp rx=0 tx=0).stop 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 shutdown_connections 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f10c006b4d0 0x7f10c006d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10dc15bbf0 0x7f10dc1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10dc071a50 0x7f10dc15d350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 --2- 172.21.15.113:0/3677977713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10dc06ddb0 0x7f10dc140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 >> 172.21.15.113:0/3677977713 conn(0x7f10dc0cc100 msgr2=0x7f10dc0af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 shutdown_connections 2024-02-26T12:19:43.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.231+0000 7f10e342d640 1 -- 172.21.15.113:0/3677977713 wait complete. 2024-02-26T12:19:43.246 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-26T12:19:43.246 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:43.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.361+0000 7f5e7abfe640 1 Processor -- start 2024-02-26T12:19:43.347 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 -- start start 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5e74154600 0x7f5e7406d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5e74071900 0x7f5e740b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7406db50 con 0x7f5e7415b340 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7406e760 con 0x7f5e74154600 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7abfe640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7406de30 con 0x7f5e74071900 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e73fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f5e7415b340 0x7f5e740711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48844/0 (socket says 172.21.15.113:48844) 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e7899a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5e74154600 0x7f5e7406d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.362+0000 7f5e73fff640 1 -- 172.21.15.113:0/2985105610 learned_addr learned my addr 172.21.15.113:0/2985105610 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:43.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7919b640 1 --2- 172.21.15.113:0/2985105610 >> v2:172.21.15.152:3300/0 conn(0x7f5e74071900 0x7f5e740b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7899a640 1 -- 172.21.15.113:0/2985105610 >> v2:172.21.15.152:3300/0 conn(0x7f5e74071900 msgr2=0x7f5e740b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7899a640 1 --2- 172.21.15.113:0/2985105610 >> v2:172.21.15.152:3300/0 conn(0x7f5e74071900 0x7f5e740b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7899a640 1 -- 172.21.15.113:0/2985105610 >> v1:172.21.15.113:6789/0 conn(0x7f5e7415b340 legacy=0x7f5e740711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7899a640 1 -- 172.21.15.113:0/2985105610 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7406e110 con 0x7f5e74154600 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e737fe640 1 -- 172.21.15.113:0/2985105610 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871802577 0 0) 0x7f5e7406db50 con 0x7f5e7415b340 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.363+0000 7f5e7899a640 1 --2- 172.21.15.113:0/2985105610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74154600 0x7f5e7406d250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e74071f30 tx=0x7f5e6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48be1b6a4efc7bda server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e737fe640 1 -- 172.21.15.113:0/2985105610 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68035020 con 0x7f5e74154600 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e737fe640 1 -- 172.21.15.113:0/2985105610 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68031830 con 0x7f5e74154600 2024-02-26T12:19:43.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e737fe640 1 -- 172.21.15.113:0/2985105610 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68031c00 con 0x7f5e74154600 2024-02-26T12:19:43.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 -- 172.21.15.113:0/2985105610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74154600 msgr2=0x7f5e7406d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/2985105610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74154600 0x7f5e7406d250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e74071f30 tx=0x7f5e6802b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 -- 172.21.15.113:0/2985105610 shutdown_connections 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/2985105610 >> v2:172.21.15.152:3300/0 conn(0x7f5e74071900 0x7f5e740b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/2985105610 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74154600 0x7f5e7406d250 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 -- 172.21.15.113:0/2985105610 >> 172.21.15.113:0/2985105610 conn(0x7f5e7406ab50 msgr2=0x7f5e7406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 -- 172.21.15.113:0/2985105610 shutdown_connections 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.364+0000 7f5e7abfe640 1 -- 172.21.15.113:0/2985105610 wait complete. 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.365+0000 7f5e7abfe640 1 Processor -- start 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.365+0000 7f5e7abfe640 1 -- start start 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 0x7f5e740b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e7415b340 0x7f5e740b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74154b60 con 0x7f5e74071900 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741549e0 con 0x7f5e7415b340 2024-02-26T12:19:43.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7abfe640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7406d790 con 0x7f5e74154600 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7899a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7899a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47664/0 (socket says 172.21.15.113:47664) 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.366+0000 7f5e7899a640 1 -- 172.21.15.113:0/3547163436 learned_addr learned my addr 172.21.15.113:0/3547163436 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7919b640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e7415b340 0x7f5e740b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e73fff640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 0x7f5e740b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 -- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 msgr2=0x7f5e740b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 0x7f5e740b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 -- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e7415b340 msgr2=0x7f5e740b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e7415b340 0x7f5e740b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 -- 172.21.15.113:0/3547163436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74142db0 con 0x7f5e74071900 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e73fff640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 0x7f5e740b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7899a640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009890 tx=0x7f5e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68041070 con 0x7f5e74071900 2024-02-26T12:19:43.355 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6803a950 con 0x7f5e74071900 2024-02-26T12:19:43.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e74145e20 con 0x7f5e74071900 2024-02-26T12:19:43.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68035040 con 0x7f5e74071900 2024-02-26T12:19:43.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.367+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e741f1eb0 con 0x7f5e74071900 2024-02-26T12:19:43.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.368+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74152f10 con 0x7f5e74071900 2024-02-26T12:19:43.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.369+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e68038020 con 0x7f5e74071900 2024-02-26T12:19:43.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.369+0000 7f5e717fa640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 0x7f5e5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.369+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e680abb80 con 0x7f5e74071900 2024-02-26T12:19:43.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.369+0000 7f5e73fff640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 0x7f5e5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.369+0000 7f5e73fff640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 0x7f5e5806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e74156820 tx=0x7f5e60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.358 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.373+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e74152f10 con 0x7f5e74071900 2024-02-26T12:19:43.539 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.554+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e741f19c0 con 0x7f5e74071900 2024-02-26T12:19:43.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.555+0000 7f5e717fa640 1 -- 172.21.15.113:0/3547163436 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f5e6807aa90 con 0x7f5e74071900 2024-02-26T12:19:43.540 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:43.540 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:43.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 msgr2=0x7f5e5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 0x7f5e5806d990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e74156820 tx=0x7f5e60009040 comp rx=0 tx=0).stop 2024-02-26T12:19:43.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 msgr2=0x7f5e74142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009890 tx=0x7f5e680046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 shutdown_connections 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5e5806b4d0 0x7f5e5806d990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5e7415b340 0x7f5e740b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5e74154600 0x7f5e740b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 --2- 172.21.15.113:0/3547163436 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5e74071900 0x7f5e74142870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 >> 172.21.15.113:0/3547163436 conn(0x7f5e7406ab50 msgr2=0x7f5e74153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 shutdown_connections 2024-02-26T12:19:43.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.557+0000 7f5e7abfe640 1 -- 172.21.15.113:0/3547163436 wait complete. 2024-02-26T12:19:43.557 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:43.557 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:43.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.675+0000 7fcb3371e640 1 Processor -- start 2024-02-26T12:19:43.661 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb3371e640 1 -- start start 2024-02-26T12:19:43.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb3371e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcb2c0b5d20 0x7fcb2c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb3371e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c0d1dc0 con 0x7fcb2c0ce930 2024-02-26T12:19:43.663 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb3371e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2c0ced60 con 0x7fcb2c15de30 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb3371e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb2c161d50 con 0x7fcb2c0b5d20 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb31cbb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcb2c0ce930 0x7fcb2c0d2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48852/0 (socket says 172.21.15.113:48852) 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.676+0000 7fcb31cbb640 1 -- 172.21.15.113:0/3947512931 learned_addr learned my addr 172.21.15.113:0/3947512931 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb30cb9640 1 --2- 172.21.15.113:0/3947512931 >> v2:172.21.15.152:3300/0 conn(0x7fcb2c0b5d20 0x7fcb2c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639749202 0 0) 0x7fcb2c0d1dc0 con 0x7fcb2c0ce930 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb18003520 con 0x7fcb2c0ce930 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645530543 0 0) 0x7fcb18003520 con 0x7fcb2c0ce930 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 >> v2:172.21.15.152:3300/0 conn(0x7fcb2c0b5d20 msgr2=0x7fcb2c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 --2- 172.21.15.113:0/3947512931 >> v2:172.21.15.152:3300/0 conn(0x7fcb2c0b5d20 0x7fcb2c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 >> v1:172.21.15.152:6789/0 conn(0x7fcb2c15de30 legacy=0x7fcb2c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c0cf000 con 0x7fcb2c0ce930 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fcb240019f0 con 0x7fcb2c0ce930 2024-02-26T12:19:43.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 >> v1:172.21.15.113:6789/0 conn(0x7fcb2c0ce930 legacy=0x7fcb2c0d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 0x7fcb18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb18004800 0x7fcb18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb180051c0 0x7fcb1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c161d50 con 0x7fcb180039b0 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1800c060 con 0x7fcb180051c0 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1800c260 con 0x7fcb18004800 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 0x7fcb18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb31cbb640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb180051c0 0x7fcb1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 -- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb18004800 msgr2=0x7fcb18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb18004800 0x7fcb18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 -- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb180051c0 msgr2=0x7fcb1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb180051c0 0x7fcb1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb31cbb640 1 -- 172.21.15.113:0/3947512931 reap_dead start 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.677+0000 7fcb314ba640 1 -- 172.21.15.113:0/3947512931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18003520 con 0x7fcb180039b0 2024-02-26T12:19:43.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.678+0000 7fcb314ba640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 0x7fcb18003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb28001720 tx=0x7fcb18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9772fa579dccf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.678+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28001370 con 0x7fcb180039b0 2024-02-26T12:19:43.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.678+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb280052d0 con 0x7fcb180039b0 2024-02-26T12:19:43.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.678+0000 7fcb23fff640 1 -- 172.21.15.113:0/3947512931 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28003830 con 0x7fcb180039b0 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 -- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 msgr2=0x7fcb18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 0x7fcb18003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb28001720 tx=0x7fcb18005830 comp rx=0 tx=0).stop 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 -- 172.21.15.113:0/3947512931 shutdown_connections 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 --2- 172.21.15.113:0/3947512931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb180039b0 0x7fcb18003dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 -- 172.21.15.113:0/3947512931 >> 172.21.15.113:0/3947512931 conn(0x7fcb2c0d0610 msgr2=0x7fcb2c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 -- 172.21.15.113:0/3947512931 shutdown_connections 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.679+0000 7fcb3371e640 1 -- 172.21.15.113:0/3947512931 wait complete. 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.680+0000 7fcb3371e640 1 Processor -- start 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.680+0000 7fcb3371e640 1 -- start start 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb180039b0 0x7fcb2c149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 0x7fcb2c1f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0b6dc0 con 0x7fcb2c1538d0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0d2340 con 0x7fcb2c1f71f0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c15e210 con 0x7fcb180039b0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47686/0 (socket says 172.21.15.113:47686) 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 -- 172.21.15.113:0/1735333675 learned_addr learned my addr 172.21.15.113:0/1735333675 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb314ba640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb180039b0 0x7fcb2c149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb31cbb640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 0x7fcb2c1f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 -- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb180039b0 msgr2=0x7fcb2c149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb180039b0 0x7fcb2c149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 -- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 msgr2=0x7fcb2c1f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 0x7fcb2c1f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 -- 172.21.15.113:0/1735333675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2c155fe0 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb31cbb640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 0x7fcb2c1f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb30cb9640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e860 tx=0x7fcb1c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c017070 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c00c940 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1562c0 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.681+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c00cd10 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.682+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c156880 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.683+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c074a50 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.683+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb1c01a070 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.684+0000 7fcb21ffb640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 0x7fcb1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.684+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb1c08a0c0 con 0x7fcb2c1538d0 2024-02-26T12:19:43.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.684+0000 7fcb314ba640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 0x7fcb1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.684+0000 7fcb314ba640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 0x7fcb1006d9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb28033000 tx=0x7fcb28009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.688+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb1c058f40 con 0x7fcb2c1538d0 2024-02-26T12:19:43.843 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.858+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb2c0d45c0 con 0x7fcb2c1538d0 2024-02-26T12:19:43.844 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.858+0000 7fcb21ffb640 1 -- 172.21.15.113:0/1735333675 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb1c058840 con 0x7fcb2c1538d0 2024-02-26T12:19:43.844 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 msgr2=0x7fcb1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 0x7fcb1006d9c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcb28033000 tx=0x7fcb28009030 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 msgr2=0x7fcb2c161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c00e860 tx=0x7fcb1c00ed20 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 shutdown_connections 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb1006b500 0x7fcb1006d9c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2c1f71f0 0x7fcb2c1f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb2c1538d0 0x7fcb2c161150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 --2- 172.21.15.113:0/1735333675 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb180039b0 0x7fcb2c149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.846 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.860+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 >> 172.21.15.113:0/1735333675 conn(0x7fcb2c0d0610 msgr2=0x7fcb2c0b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.861+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 shutdown_connections 2024-02-26T12:19:43.847 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.861+0000 7fcb3371e640 1 -- 172.21.15.113:0/1735333675 wait complete. 2024-02-26T12:19:43.857 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:43.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.975+0000 7fc63f5c8640 1 Processor -- start 2024-02-26T12:19:43.961 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.975+0000 7fc63f5c8640 1 -- start start 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63f5c8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc63815bbf0 0x7fc638071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63f5c8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc6380b3d80 0x7fc638071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63f5c8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380ced10 con 0x7fc63806ddb0 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63f5c8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380b2890 con 0x7fc63815bbf0 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63f5c8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cefb0 con 0x7fc6380b3d80 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc63815bbf0 0x7fc638071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc63815bbf0 0x7fc638071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47690/0 (socket says 172.21.15.113:47690) 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 -- 172.21.15.113:0/1267559567 learned_addr learned my addr 172.21.15.113:0/1267559567 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 -- 172.21.15.113:0/1267559567 >> v2:172.21.15.152:3300/0 conn(0x7fc6380b3d80 msgr2=0x7fc638071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 --2- 172.21.15.113:0/1267559567 >> v2:172.21.15.152:3300/0 conn(0x7fc6380b3d80 0x7fc638071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 -- 172.21.15.113:0/1267559567 >> v1:172.21.15.152:6789/0 conn(0x7fc63806ddb0 legacy=0x7fc6380cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:43.962 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.976+0000 7fc63d364640 1 -- 172.21.15.113:0/1267559567 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380cf290 con 0x7fc63815bbf0 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.977+0000 7fc63d364640 1 --2- 172.21.15.113:0/1267559567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63815bbf0 0x7fc638071340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc638067a60 tx=0x7fc63002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509826eb27e6da32 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.977+0000 7fc637fff640 1 -- 172.21.15.113:0/1267559567 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63002cb00 con 0x7fc63815bbf0 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.977+0000 7fc637fff640 1 -- 172.21.15.113:0/1267559567 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63002cca0 con 0x7fc63815bbf0 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.977+0000 7fc637fff640 1 -- 172.21.15.113:0/1267559567 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630034610 con 0x7fc63815bbf0 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 -- 172.21.15.113:0/1267559567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63815bbf0 msgr2=0x7fc638071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/1267559567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63815bbf0 0x7fc638071340 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc638067a60 tx=0x7fc63002bf60 comp rx=0 tx=0).stop 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 -- 172.21.15.113:0/1267559567 shutdown_connections 2024-02-26T12:19:43.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/1267559567 >> v2:172.21.15.152:3300/0 conn(0x7fc6380b3d80 0x7fc638071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/1267559567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63815bbf0 0x7fc638071340 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 -- 172.21.15.113:0/1267559567 >> 172.21.15.113:0/1267559567 conn(0x7fc6380cc100 msgr2=0x7fc6380cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 -- 172.21.15.113:0/1267559567 shutdown_connections 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.978+0000 7fc63f5c8640 1 -- 172.21.15.113:0/1267559567 wait complete. 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.979+0000 7fc63f5c8640 1 Processor -- start 2024-02-26T12:19:43.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.979+0000 7fc63f5c8640 1 -- start start 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6380b3d80 0x7fc6381555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc63815bbf0 0x7fc6381529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815bfd0 con 0x7fc63806ddb0 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380720f0 con 0x7fc6380b3d80 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63f5c8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815c150 con 0x7fc63815bbf0 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47698/0 (socket says 172.21.15.113:47698) 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 -- 172.21.15.113:0/2715334127 learned_addr learned my addr 172.21.15.113:0/2715334127 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63cb63640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6380b3d80 0x7fc6381555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 -- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc63815bbf0 msgr2=0x7fc6381529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63db65640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc63815bbf0 0x7fc6381529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc63815bbf0 0x7fc6381529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 -- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6380b3d80 msgr2=0x7fc6381555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6380b3d80 0x7fc6381555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 -- 172.21.15.113:0/2715334127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380b0180 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc63d364640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc630000f80 tx=0x7fc630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.980+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630043020 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.981+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63002ce50 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.981+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380afbc0 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.981+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63003e690 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.981+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380c9d70 con 0x7fc63806ddb0 2024-02-26T12:19:43.968 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.982+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638074a50 con 0x7fc63806ddb0 2024-02-26T12:19:43.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.982+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc630046020 con 0x7fc63806ddb0 2024-02-26T12:19:43.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.983+0000 7fc635ffb640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 0x7fc62406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:43.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.983+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6300ac9b0 con 0x7fc63806ddb0 2024-02-26T12:19:43.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.983+0000 7fc63cb63640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 0x7fc62406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:43.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.983+0000 7fc63cb63640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 0x7fc62406d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc63815a650 tx=0x7fc62c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:43.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:43.987+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc63004d030 con 0x7fc63806ddb0 2024-02-26T12:19:44.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.155+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc638072390 con 0x7fc63806ddb0 2024-02-26T12:19:44.141 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.156+0000 7fc635ffb640 1 -- 172.21.15.113:0/2715334127 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc63007b830 con 0x7fc63806ddb0 2024-02-26T12:19:44.141 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 msgr2=0x7fc62406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 0x7fc62406d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc63815a650 tx=0x7fc62c009040 comp rx=0 tx=0).stop 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 msgr2=0x7fc6380af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc630000f80 tx=0x7fc630004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 shutdown_connections 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc62406b4d0 0x7fc62406d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.143 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc63815bbf0 0x7fc6381529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6380b3d80 0x7fc6381555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 --2- 172.21.15.113:0/2715334127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc63806ddb0 0x7fc6380af4c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.157+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 >> 172.21.15.113:0/2715334127 conn(0x7fc6380cc100 msgr2=0x7fc6380ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:44.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.158+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 shutdown_connections 2024-02-26T12:19:44.144 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.158+0000 7fc63f5c8640 1 -- 172.21.15.113:0/2715334127 wait complete. 2024-02-26T12:19:44.153 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.271+0000 7f6a52a36640 1 Processor -- start 2024-02-26T12:19:44.257 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.272+0000 7f6a52a36640 1 -- start start 2024-02-26T12:19:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.272+0000 7f6a52a36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6a4c071e60 0x7f6a4c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.272+0000 7f6a52a36640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c070100 con 0x7f6a4c0cb310 2024-02-26T12:19:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.272+0000 7f6a52a36640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0c4a30 con 0x7f6a4c145630 2024-02-26T12:19:44.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.272+0000 7f6a52a36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c145a10 con 0x7f6a4c071e60 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a50fd3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6a4c0cb310 0x7f6a4c0c57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48864/0 (socket says 172.21.15.113:48864) 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a50fd3640 1 -- 172.21.15.113:0/2928324732 learned_addr learned my addr 172.21.15.113:0/2928324732 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293338220 0 0) 0x7f6a4c070100 con 0x7f6a4c0cb310 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4b7fe640 1 --2- 172.21.15.113:0/2928324732 >> v2:172.21.15.152:3300/0 conn(0x7f6a4c071e60 0x7f6a4c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a34003520 con 0x7f6a4c0cb310 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2444103866 0 0) 0x7f6a34003520 con 0x7f6a4c0cb310 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 >> v2:172.21.15.152:3300/0 conn(0x7f6a4c071e60 msgr2=0x7f6a4c0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 --2- 172.21.15.113:0/2928324732 >> v2:172.21.15.152:3300/0 conn(0x7f6a4c071e60 0x7f6a4c0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 >> v1:172.21.15.152:6789/0 conn(0x7f6a4c145630 legacy=0x7f6a4c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0c4d10 con 0x7f6a4c0cb310 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f6a440019f0 con 0x7f6a4c0cb310 2024-02-26T12:19:44.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 >> v1:172.21.15.113:6789/0 conn(0x7f6a4c0cb310 legacy=0x7f6a4c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 0x7f6a34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a34004800 0x7f6a34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a340051c0 0x7f6a3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c145a10 con 0x7f6a340039b0 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3400c070 con 0x7f6a340051c0 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3400c270 con 0x7f6a34004800 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 0x7f6a34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a50fd3640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a340051c0 0x7f6a3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4b7fe640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a34004800 0x7f6a34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 -- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a34004800 msgr2=0x7f6a34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a34004800 0x7f6a34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 -- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a340051c0 msgr2=0x7f6a3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a340051c0 0x7f6a3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.273+0000 7f6a4bfff640 1 -- 172.21.15.113:0/2928324732 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34003520 con 0x7f6a340039b0 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a50fd3640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a340051c0 0x7f6a3400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a50fd3640 1 -- 172.21.15.113:0/2928324732 reap_dead start 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 0x7f6a34003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c001330 tx=0x7f6a34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f5047c921f558f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c001370 con 0x7f6a340039b0 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0052d0 con 0x7f6a340039b0 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.274+0000 7f6a4affd640 1 -- 172.21.15.113:0/2928324732 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c003830 con 0x7f6a340039b0 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 -- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 msgr2=0x7f6a34003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 0x7f6a34003dd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c001330 tx=0x7f6a34005830 comp rx=0 tx=0).stop 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 -- 172.21.15.113:0/2928324732 shutdown_connections 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 --2- 172.21.15.113:0/2928324732 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a340039b0 0x7f6a34003dd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 -- 172.21.15.113:0/2928324732 >> 172.21.15.113:0/2928324732 conn(0x7f6a4c0cfad0 msgr2=0x7f6a4c0cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 -- 172.21.15.113:0/2928324732 shutdown_connections 2024-02-26T12:19:44.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.275+0000 7f6a52a36640 1 -- 172.21.15.113:0/2928324732 wait complete. 2024-02-26T12:19:44.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.276+0000 7f6a52a36640 1 Processor -- start 2024-02-26T12:19:44.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.276+0000 7f6a52a36640 1 -- start start 2024-02-26T12:19:44.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a340039b0 0x7f6a4c0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a4c15d210 0x7f6a4c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0cb9b0 con 0x7f6a4c0b4060 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0cb760 con 0x7f6a4c15d210 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a52a36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c52d0 con 0x7f6a340039b0 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47724/0 (socket says 172.21.15.113:47724) 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 -- 172.21.15.113:0/3116498943 learned_addr learned my addr 172.21.15.113:0/3116498943 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a50fd3640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a4c15d210 0x7f6a4c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a340039b0 0x7f6a4c0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 -- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a340039b0 msgr2=0x7f6a4c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.267 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a340039b0 0x7f6a4c0b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 -- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a4c15d210 msgr2=0x7f6a4c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a4c15d210 0x7f6a4c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 -- 172.21.15.113:0/3116498943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c15c170 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.277+0000 7f6a4b7fe640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a400116d0 tx=0x7f6a40011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.278+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f960 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.278+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000fb00 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.278+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c15c450 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.278+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40015460 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.278+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c15ca10 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.279+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c074a50 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.279+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a40015600 con 0x7f6a4c0b4060 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.279+0000 7f6a48ff9640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 0x7f6a3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.280+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a4008ab80 con 0x7f6a4c0b4060 2024-02-26T12:19:44.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.280+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 0x7f6a3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.280+0000 7f6a4bfff640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 0x7f6a3806d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c038000 tx=0x7f6a3c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.284+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a40019030 con 0x7f6a4c0b4060 2024-02-26T12:19:44.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.454+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a4c0cae60 con 0x7f6a4c0b4060 2024-02-26T12:19:44.439 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.454+0000 7f6a48ff9640 1 -- 172.21.15.113:0/3116498943 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a40059970 con 0x7f6a4c0b4060 2024-02-26T12:19:44.439 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:44.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 msgr2=0x7f6a3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 0x7f6a3806d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c038000 tx=0x7f6a3c009030 comp rx=0 tx=0).stop 2024-02-26T12:19:44.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 msgr2=0x7f6a4c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6a400116d0 tx=0x7f6a40011b90 comp rx=0 tx=0).stop 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 shutdown_connections 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a3806b4d0 0x7f6a3806d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a4c15d210 0x7f6a4c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a4c0b4060 0x7f6a4c0b44e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 --2- 172.21.15.113:0/3116498943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a340039b0 0x7f6a4c0b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 >> 172.21.15.113:0/3116498943 conn(0x7f6a4c0cfad0 msgr2=0x7f6a4c071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 shutdown_connections 2024-02-26T12:19:44.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.456+0000 7f6a52a36640 1 -- 172.21.15.113:0/3116498943 wait complete. 2024-02-26T12:19:44.452 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-02-26T12:19:44.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.568+0000 7fe5fdd1e640 1 Processor -- start 2024-02-26T12:19:44.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.568+0000 7fe5fdd1e640 1 -- start start 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5fdd1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5f815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5fdd1e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f815eb60 con 0x7fe5f806d250 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5fdd1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f815ee40 con 0x7fe5f815bf80 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5fdd1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80af130 con 0x7fe5f80aed50 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f6ffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe5f806d250 0x7fe5f80b2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48870/0 (socket says 172.21.15.113:48870) 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f6ffd640 1 -- 172.21.15.113:0/25868410 learned_addr learned my addr 172.21.15.113:0/25868410 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571423171 0 0) 0x7fe5f815eb60 con 0x7fe5f806d250 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e0003520 con 0x7fe5f806d250 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f77fe640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5f815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2617155371 0 0) 0x7fe5e0003520 con 0x7fe5f806d250 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 msgr2=0x7fe5f815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5f815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 >> v1:172.21.15.152:6789/0 conn(0x7fe5f815bf80 legacy=0x7fe5f80b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f815f120 con 0x7fe5f806d250 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe5ec001690 con 0x7fe5f806d250 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 >> v1:172.21.15.113:6789/0 conn(0x7fe5f806d250 legacy=0x7fe5f80b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5e00039e0 0x7fe5e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5e0004d40 0x7fe5e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e000bb50 con 0x7fe5e0004d40 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e000bcd0 con 0x7fe5e00039e0 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.569+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e000bea0 con 0x7fe5f80aed50 2024-02-26T12:19:44.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5e0004d40 0x7fe5e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f77fe640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5e00039e0 0x7fe5e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f6ffd640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 -- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 msgr2=0x7fe5e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f80aed50 0x7fe5e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 -- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5e00039e0 msgr2=0x7fe5e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5e00039e0 0x7fe5e0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.570+0000 7fe5f7fff640 1 -- 172.21.15.113:0/25868410 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e0003520 con 0x7fe5e0004d40 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5e0004d40 0x7fe5e00051c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0001e80 tx=0x7fe5e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f71d1277502e3d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0001a70 con 0x7fe5e0004d40 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0003b70 con 0x7fe5e0004d40 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5f67fc640 1 -- 172.21.15.113:0/25868410 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00050d0 con 0x7fe5e0004d40 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/25868410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5e0004d40 msgr2=0x7fe5e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/25868410 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5e0004d40 0x7fe5e00051c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0001e80 tx=0x7fe5e0005830 comp rx=0 tx=0).stop 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5f7fff640 1 -- 172.21.15.113:0/25868410 reap_dead start 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/25868410 shutdown_connections 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/25868410 >> 172.21.15.113:0/25868410 conn(0x7fe5f806ab50 msgr2=0x7fe5f806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/25868410 shutdown_connections 2024-02-26T12:19:44.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.571+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/25868410 wait complete. 2024-02-26T12:19:44.565 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.572+0000 7fe5fdd1e640 1 Processor -- start 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 -- start start 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f80a8a40 0x7fe5f8146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f8144e00 0x7fe5f8146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b4760 con 0x7fe5f8145280 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b3420 con 0x7fe5f80a8a40 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5fdd1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b48e0 con 0x7fe5f8144e00 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5f7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47738/0 (socket says 172.21.15.113:47738) 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5f7fff640 1 -- 172.21.15.113:0/1875191343 learned_addr learned my addr 172.21.15.113:0/1875191343 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.573+0000 7fe5f6ffd640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f8144e00 0x7fe5f8146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f77fe640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f80a8a40 0x7fe5f8146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 -- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f8144e00 msgr2=0x7fe5f8146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f8144e00 0x7fe5f8146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 -- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f80a8a40 msgr2=0x7fe5f8146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f80a8a40 0x7fe5f8146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 -- 172.21.15.113:0/1875191343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8145770 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5f7fff640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0001fa0 tx=0x7fe5f00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0001a70 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f0003970 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0007db0 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8145a50 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.574+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f8146010 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.575+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f8074a50 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.575+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe5f0007030 con 0x7fe5f8145280 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.576+0000 7fe5dffff640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:44.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.576+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f00ab350 con 0x7fe5f8145280 2024-02-26T12:19:44.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.576+0000 7fe5f77fe640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:44.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.576+0000 7fe5f77fe640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 0x7fe5e406d9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8006fd0 tx=0x7fe5e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:44.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.580+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5f0033020 con 0x7fe5f8145280 2024-02-26T12:19:44.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:44.815+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fe5f806c1d0 con 0x7fe5f8145280 2024-02-26T12:19:45.514 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.529+0000 7fe5dffff640 1 -- 172.21.15.113:0/1875191343 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v47) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe5f007a140 con 0x7fe5f8145280 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 msgr2=0x7fe5e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 0x7fe5e406d9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8006fd0 tx=0x7fe5e8008040 comp rx=0 tx=0).stop 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 msgr2=0x7fe5f81473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0001fa0 tx=0x7fe5f00014a0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 shutdown_connections 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe5e406b500 0x7fe5e406d9c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5f8145280 0x7fe5f81473d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5f8144e00 0x7fe5f8146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 --2- 172.21.15.113:0/1875191343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe5f80a8a40 0x7fe5f8146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 >> 172.21.15.113:0/1875191343 conn(0x7fe5f806ab50 msgr2=0x7fe5f80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:45.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 shutdown_connections 2024-02-26T12:19:45.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.532+0000 7fe5fdd1e640 1 -- 172.21.15.113:0/1875191343 wait complete. 2024-02-26T12:19:45.529 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-02-26T12:19:45.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 Processor -- start 2024-02-26T12:19:45.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 -- start start 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56980cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f56980d0110 0x7f56980cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569815e200 con 0x7f569815de20 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980ce0a0 con 0x7f56980d0110 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.648+0000 7f569ee05640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cdc10 con 0x7f56980cc900 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f56980d0110 0x7f56980cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569cba1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f569815de20 0x7f56980cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48884/0 (socket says 172.21.15.113:48884) 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569cba1640 1 -- 172.21.15.113:0/3559066203 learned_addr learned my addr 172.21.15.113:0/3559066203 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:45.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 --2- 172.21.15.113:0/3559066203 >> v2:172.21.15.113:3300/0 conn(0x7f56980d0110 0x7f56980cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47742/0 (socket says 172.21.15.113:47742) 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f5697fff640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56980cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 -- 172.21.15.113:0/3559066203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 msgr2=0x7f56980cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56980cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 -- 172.21.15.113:0/3559066203 >> v1:172.21.15.113:6789/0 conn(0x7f569815de20 legacy=0x7f56980cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f569d3a2640 1 -- 172.21.15.113:0/3559066203 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569806b6f0 con 0x7f56980d0110 2024-02-26T12:19:45.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.649+0000 7f56977fe640 1 -- 172.21.15.113:0/3559066203 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408402167 0 0) 0x7f569815e200 con 0x7f569815de20 2024-02-26T12:19:45.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569d3a2640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f56980cb320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5392d6d6cc637b79 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:45.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f56977fe640 1 -- 172.21.15.113:0/3559066203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690039070 con 0x7f56980d0110 2024-02-26T12:19:45.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f56977fe640 1 -- 172.21.15.113:0/3559066203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569002cb30 con 0x7f56980d0110 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f56977fe640 1 -- 172.21.15.113:0/3559066203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690034440 con 0x7f56980d0110 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 -- 172.21.15.113:0/3559066203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 msgr2=0x7f56980cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f56980cb320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569002bd80 comp rx=0 tx=0).stop 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 -- 172.21.15.113:0/3559066203 shutdown_connections 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f56980cb320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 --2- 172.21.15.113:0/3559066203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56980cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 -- 172.21.15.113:0/3559066203 >> 172.21.15.113:0/3559066203 conn(0x7f5698099a40 msgr2=0x7f56980d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 -- 172.21.15.113:0/3559066203 shutdown_connections 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.650+0000 7f569ee05640 1 -- 172.21.15.113:0/3559066203 wait complete. 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.651+0000 7f569ee05640 1 Processor -- start 2024-02-26T12:19:45.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.651+0000 7f569ee05640 1 -- start start 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56981515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f569815de20 0x7f56981534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd5c0 con 0x7f56980d0110 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd2e0 con 0x7f569815de20 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f569ee05640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cd8a0 con 0x7f56980cc900 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f5697fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f5697fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47746/0 (socket says 172.21.15.113:47746) 2024-02-26T12:19:45.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.652+0000 7f5697fff640 1 -- 172.21.15.113:0/1641649392 learned_addr learned my addr 172.21.15.113:0/1641649392 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 -- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 msgr2=0x7f56981515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56981515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f569d3a2640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f569815de20 0x7f56981534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 -- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f569815de20 msgr2=0x7f56981534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f569815de20 0x7f56981534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 -- 172.21.15.113:0/1641649392 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56981e9a00 con 0x7f56980d0110 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f5697fff640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f568400d620 tx=0x7f568400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400b620 con 0x7f56980d0110 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684019070 con 0x7f56980d0110 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56981e9ce0 con 0x7f56980d0110 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400ba00 con 0x7f56980d0110 2024-02-26T12:19:45.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.653+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980c52f0 con 0x7f56980d0110 2024-02-26T12:19:45.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.654+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5698152410 con 0x7f56980d0110 2024-02-26T12:19:45.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.654+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f568400bba0 con 0x7f56980d0110 2024-02-26T12:19:45.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.655+0000 7f56957fa640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 0x7f567c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:45.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.655+0000 7f569cba1640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 0x7f567c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:45.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.655+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f568408a620 con 0x7f56980d0110 2024-02-26T12:19:45.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.655+0000 7f569cba1640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 0x7f567c06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f568c007fd0 tx=0x7f568c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:45.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.659+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56840594a0 con 0x7f56980d0110 2024-02-26T12:19:45.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.830+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f56981ea200 con 0x7f56980d0110 2024-02-26T12:19:45.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.835+0000 7f56957fa640 1 -- 172.21.15.113:0/1641649392 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5684058da0 con 0x7f56980d0110 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 msgr2=0x7f567c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 0x7f567c06d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f568c007fd0 tx=0x7f568c007920 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 msgr2=0x7f5698152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f568400d620 tx=0x7f568400dae0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 shutdown_connections 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f567c06b4d0 0x7f567c06d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f569815de20 0x7f56981534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f56980d0110 0x7f5698152b40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 --2- 172.21.15.113:0/1641649392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f56980cc900 0x7f56981515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 >> 172.21.15.113:0/1641649392 conn(0x7f5698099a40 msgr2=0x7f569806e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 shutdown_connections 2024-02-26T12:19:45.823 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:45.837+0000 7f569ee05640 1 -- 172.21.15.113:0/1641649392 wait complete. 2024-02-26T12:19:45.833 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-02-26T12:19:45.833 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-26T12:19:45.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-02-26T12:19:45.920 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-02-26T12:19:45.920 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:45.920 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:45.935 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:45.935 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:45.990 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:45.990 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:46.045 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:46.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.201+0000 7faaabe36640 1 Processor -- start 2024-02-26T12:19:46.186 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.201+0000 7faaabe36640 1 -- start start 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaabe36640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faaa40aed50 0x7faaa415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaabe36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaabe36640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa415eb60 con 0x7faaa406d250 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaabe36640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40af130 con 0x7faaa40aed50 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaabe36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415ee40 con 0x7faaa415bf80 2024-02-26T12:19:46.188 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa9bd2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7faaa40aed50 0x7faaa415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa93d1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7faaa406d250 0x7faaa40b2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48890/0 (socket says 172.21.15.113:48890) 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa93d1640 1 -- 172.21.15.113:0/1280844231 learned_addr learned my addr 172.21.15.113:0/1280844231 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaaa3d3640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1280844231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 msgr2=0x7faaa415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa9bd2640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1280844231 >> v1:172.21.15.113:6789/0 conn(0x7faaa406d250 legacy=0x7faaa40b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.202+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1280844231 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa415f120 con 0x7faaa40aed50 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaa9bd2640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40aed50 0x7faaa415e460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faaa00097a0 tx=0x7faaa002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94774c3d7681e61c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaa8bd0640 1 -- 172.21.15.113:0/1280844231 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0035020 con 0x7faaa40aed50 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaa8bd0640 1 -- 172.21.15.113:0/1280844231 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa0031830 con 0x7faaa40aed50 2024-02-26T12:19:46.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaa8bd0640 1 -- 172.21.15.113:0/1280844231 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0031c00 con 0x7faaa40aed50 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaabe36640 1 -- 172.21.15.113:0/1280844231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40aed50 msgr2=0x7faaa415e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.203+0000 7faaabe36640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40aed50 0x7faaa415e460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faaa00097a0 tx=0x7faaa002b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 -- 172.21.15.113:0/1280844231 shutdown_connections 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 --2- 172.21.15.113:0/1280844231 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40aed50 0x7faaa415e460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 -- 172.21.15.113:0/1280844231 >> 172.21.15.113:0/1280844231 conn(0x7faaa406ab50 msgr2=0x7faaa406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 -- 172.21.15.113:0/1280844231 shutdown_connections 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.204+0000 7faaabe36640 1 -- 172.21.15.113:0/1280844231 wait complete. 2024-02-26T12:19:46.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.205+0000 7faaabe36640 1 Processor -- start 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.205+0000 7faaabe36640 1 -- start start 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.205+0000 7faaabe36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.205+0000 7faaabe36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 0x7faaa41e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.205+0000 7faaabe36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa40cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaabe36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b4050 con 0x7faaa406d250 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaabe36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b3420 con 0x7faaa40aed50 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaabe36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b41d0 con 0x7faaa415bf80 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47764/0 (socket says 172.21.15.113:47764) 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1244657050 learned_addr learned my addr 172.21.15.113:0/1244657050 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa93d1640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 0x7faaa41e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaaa3d3640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa40cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 msgr2=0x7faaa40cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa40cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 msgr2=0x7faaa41e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 0x7faaa41e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 -- 172.21.15.113:0/1244657050 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40acc70 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaaa3d3640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa40cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa93d1640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 0x7faaa41e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaa9bd2640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009890 tx=0x7faaa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0041070 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa003b920 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa40acf50 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0035040 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.206+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40ad510 con 0x7faaa406d250 2024-02-26T12:19:46.194 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.207+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa4074a50 con 0x7faaa406d250 2024-02-26T12:19:46.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.208+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaa004c060 con 0x7faaa406d250 2024-02-26T12:19:46.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.208+0000 7faa9a7fc640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 0x7faa8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.208+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaa00abbb0 con 0x7faaa406d250 2024-02-26T12:19:46.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.208+0000 7faaa93d1640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 0x7faa8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.195 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.208+0000 7faaa93d1640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 0x7faa8806d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faaa40ae570 tx=0x7faa94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.212+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faaa007aa40 con 0x7faaa406d250 2024-02-26T12:19:46.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.385+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa40b49c0 con 0x7faaa406d250 2024-02-26T12:19:46.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.386+0000 7faa9a7fc640 1 -- 172.21.15.113:0/1244657050 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7faaa007a340 con 0x7faaa406d250 2024-02-26T12:19:46.371 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:46.371 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 msgr2=0x7faa8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 0x7faa8806d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faaa40ae570 tx=0x7faa94009040 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 msgr2=0x7faaa40add10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009890 tx=0x7faaa00046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 shutdown_connections 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7faa8806b4d0 0x7faa8806d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faaa415bf80 0x7faaa40cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaa40aed50 0x7faaa41e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 --2- 172.21.15.113:0/1244657050 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa406d250 0x7faaa40add10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 >> 172.21.15.113:0/1244657050 conn(0x7faaa406ab50 msgr2=0x7faaa415aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 shutdown_connections 2024-02-26T12:19:46.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.388+0000 7faaabe36640 1 -- 172.21.15.113:0/1244657050 wait complete. 2024-02-26T12:19:46.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:46.385 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:46.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.502+0000 7f112a1f7640 1 Processor -- start 2024-02-26T12:19:46.488 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.502+0000 7f112a1f7640 1 -- start start 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f112a1f7640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f112415a9d0 0x7f11240b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f112a1f7640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11240cbf20 con 0x7f112415adb0 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f112a1f7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11240cc200 con 0x7f11240cba70 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f112a1f7640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11240cc4e0 con 0x7f112415a9d0 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f11237fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f112415a9d0 0x7f11240b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f11237fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f112415a9d0 0x7f11240b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47776/0 (socket says 172.21.15.113:47776) 2024-02-26T12:19:46.489 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.503+0000 7f11237fe640 1 -- 172.21.15.113:0/3264773064 learned_addr learned my addr 172.21.15.113:0/3264773064 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.504+0000 7f11237fe640 1 -- 172.21.15.113:0/3264773064 >> v1:172.21.15.152:6789/0 conn(0x7f11240cba70 legacy=0x7f112415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.504+0000 7f11237fe640 1 -- 172.21.15.113:0/3264773064 >> v1:172.21.15.113:6789/0 conn(0x7f112415adb0 legacy=0x7f11240cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.504+0000 7f11237fe640 1 -- 172.21.15.113:0/3264773064 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11240ce5c0 con 0x7f112415a9d0 2024-02-26T12:19:46.490 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.504+0000 7f1122ffd640 1 -- 172.21.15.113:0/3264773064 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467325660 0 0) 0x7f11240cbf20 con 0x7f112415adb0 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.504+0000 7f11237fe640 1 --2- 172.21.15.113:0/3264773064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f112415a9d0 0x7f11240b00e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1114009870 tx=0x7f111402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7019bb49941c3a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f1122ffd640 1 -- 172.21.15.113:0/3264773064 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111402f840 con 0x7f112415a9d0 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f1122ffd640 1 -- 172.21.15.113:0/3264773064 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111402f9e0 con 0x7f112415a9d0 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f1122ffd640 1 -- 172.21.15.113:0/3264773064 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111402fdb0 con 0x7f112415a9d0 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 -- 172.21.15.113:0/3264773064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f112415a9d0 msgr2=0x7f11240b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3264773064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f112415a9d0 0x7f11240b00e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1114009870 tx=0x7f111402ba20 comp rx=0 tx=0).stop 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 -- 172.21.15.113:0/3264773064 shutdown_connections 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3264773064 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f112415a9d0 0x7f11240b00e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.491 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 -- 172.21.15.113:0/3264773064 >> 172.21.15.113:0/3264773064 conn(0x7f1124099a40 msgr2=0x7f11240d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 -- 172.21.15.113:0/3264773064 shutdown_connections 2024-02-26T12:19:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.505+0000 7f112a1f7640 1 -- 172.21.15.113:0/3264773064 wait complete. 2024-02-26T12:19:46.492 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.506+0000 7f112a1f7640 1 Processor -- start 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.506+0000 7f112a1f7640 1 -- start start 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f112415a9d0 0x7f1124156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 0x7f1124146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112415ef50 con 0x7f11240cba70 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112415edd0 con 0x7f112415adb0 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f112a1f7640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ceae0 con 0x7f112415a9d0 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47782/0 (socket says 172.21.15.113:47782) 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 -- 172.21.15.113:0/3544571808 learned_addr learned my addr 172.21.15.113:0/3544571808 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f1123fff640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 0x7f1124146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.494 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 -- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f112415a9d0 msgr2=0x7f1124156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f112415a9d0 0x7f1124156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 -- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 msgr2=0x7f1124146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 0x7f1124146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f11237fe640 1 -- 172.21.15.113:0/3544571808 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1124156750 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.507+0000 7f1123fff640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 0x7f1124146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f11237fe640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11140090b0 tx=0x7f1114004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114047070 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114037cc0 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1124156a20 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114004270 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.508+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1124156fe0 con 0x7f11240cba70 2024-02-26T12:19:46.495 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.509+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1124068180 con 0x7f11240cba70 2024-02-26T12:19:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.509+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f111404a070 con 0x7f11240cba70 2024-02-26T12:19:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.510+0000 7f1120ff9640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 0x7f110406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.510+0000 7f111affd640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 0x7f110406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.510+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11140ac5a0 con 0x7f11240cba70 2024-02-26T12:19:46.496 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.510+0000 7f111affd640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 0x7f110406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f110c000f60 tx=0x7f110c0079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.499 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.514+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1114033030 con 0x7f11240cba70 2024-02-26T12:19:46.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.686+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11240b67d0 con 0x7f11240cba70 2024-02-26T12:19:46.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.687+0000 7f1120ff9640 1 -- 172.21.15.113:0/3544571808 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f111407b430 con 0x7f11240cba70 2024-02-26T12:19:46.672 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:46.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 msgr2=0x7f110406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 0x7f110406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f110c000f60 tx=0x7f110c0079b0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 msgr2=0x7f1124154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11140090b0 tx=0x7f1114004730 comp rx=0 tx=0).stop 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 shutdown_connections 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f110406b4d0 0x7f110406d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f112415adb0 0x7f1124146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f112415a9d0 0x7f1124156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 --2- 172.21.15.113:0/3544571808 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11240cba70 0x7f1124154bd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 >> 172.21.15.113:0/3544571808 conn(0x7f1124099a40 msgr2=0x7f11240d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 shutdown_connections 2024-02-26T12:19:46.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.689+0000 7f112a1f7640 1 -- 172.21.15.113:0/3544571808 wait complete. 2024-02-26T12:19:46.685 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:46.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.803+0000 7f51b8036640 1 Processor -- start 2024-02-26T12:19:46.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.803+0000 7f51b8036640 1 -- start start 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b8036640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51b0161ef0 0x7f51b0168940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b8036640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b00b33f0 con 0x7f51b01581e0 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b8036640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b00b36d0 con 0x7f51b006b7d0 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b8036640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b00b39b0 con 0x7f51b0161ef0 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b65d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51b0161ef0 0x7f51b0168940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b5dd2640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f51b01581e0 0x7f51b006be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48894/0 (socket says 172.21.15.113:48894) 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b5dd2640 1 -- 172.21.15.113:0/3756961780 learned_addr learned my addr 172.21.15.113:0/3756961780 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b65d3640 1 --2- 172.21.15.113:0/3756961780 >> v2:172.21.15.113:3300/0 conn(0x7f51b0161ef0 0x7f51b0168940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47786/0 (socket says 172.21.15.113:47786) 2024-02-26T12:19:46.789 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b65d3640 1 -- 172.21.15.113:0/3756961780 >> v1:172.21.15.152:6789/0 conn(0x7f51b006b7d0 legacy=0x7f51b01617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:46.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b65d3640 1 -- 172.21.15.113:0/3756961780 >> v1:172.21.15.113:6789/0 conn(0x7f51b01581e0 legacy=0x7f51b006be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b65d3640 1 -- 172.21.15.113:0/3756961780 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00b3c90 con 0x7f51b0161ef0 2024-02-26T12:19:46.790 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.804+0000 7f51b4dd0640 1 -- 172.21.15.113:0/3756961780 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459396380 0 0) 0x7f51b00b33f0 con 0x7f51b01581e0 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b65d3640 1 --2- 172.21.15.113:0/3756961780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b0161ef0 0x7f51b0168940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009d90 tx=0x7f51a802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00514727af14257 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b4dd0640 1 -- 172.21.15.113:0/3756961780 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8039070 con 0x7f51b0161ef0 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b4dd0640 1 -- 172.21.15.113:0/3756961780 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a802cbd0 con 0x7f51b0161ef0 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b4dd0640 1 -- 172.21.15.113:0/3756961780 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8034440 con 0x7f51b0161ef0 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b8036640 1 -- 172.21.15.113:0/3756961780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b0161ef0 msgr2=0x7f51b0168940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b8036640 1 --2- 172.21.15.113:0/3756961780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b0161ef0 0x7f51b0168940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009d90 tx=0x7f51a802be20 comp rx=0 tx=0).stop 2024-02-26T12:19:46.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b8036640 1 -- 172.21.15.113:0/3756961780 shutdown_connections 2024-02-26T12:19:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b8036640 1 --2- 172.21.15.113:0/3756961780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b0161ef0 0x7f51b0168940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.805+0000 7f51b8036640 1 -- 172.21.15.113:0/3756961780 >> 172.21.15.113:0/3756961780 conn(0x7f51b006db80 msgr2=0x7f51b006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.806+0000 7f51b8036640 1 -- 172.21.15.113:0/3756961780 shutdown_connections 2024-02-26T12:19:46.792 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.806+0000 7f51b8036640 1 -- 172.21.15.113:0/3756961780 wait complete. 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 Processor -- start 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 -- start start 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51b006b7d0 0x7f51b00ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b0161ef0 0x7f51b01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00b4490 con 0x7f51b01581e0 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b01585c0 con 0x7f51b0161ef0 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b8036640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00add40 con 0x7f51b006b7d0 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b55d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b55d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47798/0 (socket says 172.21.15.113:47798) 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.807+0000 7f51b55d1640 1 -- 172.21.15.113:0/1541235291 learned_addr learned my addr 172.21.15.113:0/1541235291 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 -- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51b006b7d0 msgr2=0x7f51b00ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51b006b7d0 0x7f51b00ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 -- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b0161ef0 msgr2=0x7f51b01509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b0161ef0 0x7f51b01509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 -- 172.21.15.113:0/1541235291 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00ad130 con 0x7f51b01581e0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b55d1640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b420 tx=0x7f51a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0011830 con 0x7f51b01581e0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0016070 con 0x7f51b01581e0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0011c10 con 0x7f51b01581e0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00ad410 con 0x7f51b01581e0 2024-02-26T12:19:46.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.808+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b00ad9d0 con 0x7f51b01581e0 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.809+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b0074a50 con 0x7f51b01581e0 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.810+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51a001b460 con 0x7f51b01581e0 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.810+0000 7f51a67fc640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 0x7f519406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.810+0000 7f51b5dd2640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 0x7f519406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.810+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51a0089cf0 con 0x7f51b01581e0 2024-02-26T12:19:46.796 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.810+0000 7f51b5dd2640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 0x7f519406d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51ac005880 tx=0x7f51ac007950 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:46.799 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.814+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51a008e070 con 0x7f51b01581e0 2024-02-26T12:19:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.984+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51b00b1a90 con 0x7f51b01581e0 2024-02-26T12:19:46.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.984+0000 7f51a67fc640 1 -- 172.21.15.113:0/1541235291 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51a0020020 con 0x7f51b01581e0 2024-02-26T12:19:46.969 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:46.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 msgr2=0x7f519406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 0x7f519406d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51ac005880 tx=0x7f51ac007950 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 msgr2=0x7f51b0150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b420 tx=0x7f51a000b8e0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 shutdown_connections 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f519406b4d0 0x7f519406d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b0161ef0 0x7f51b01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f51b01581e0 0x7f51b0150480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 --2- 172.21.15.113:0/1541235291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f51b006b7d0 0x7f51b00ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 >> 172.21.15.113:0/1541235291 conn(0x7f51b006db80 msgr2=0x7f51b015f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 shutdown_connections 2024-02-26T12:19:46.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:46.986+0000 7f51b8036640 1 -- 172.21.15.113:0/1541235291 wait complete. 2024-02-26T12:19:46.982 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:47.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.099+0000 7f7a00c60640 1 Processor -- start 2024-02-26T12:19:47.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 -- start start 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79fc15ba50 0x7f79fc09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79fc15be30 0x7f79fc0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc099d70 con 0x7f79fc0cd4c0 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc099b20 con 0x7f79fc15ba50 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.100+0000 7f7a00c60640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc09a050 con 0x7f79fc15be30 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79fc15ba50 0x7f79fc09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fad9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f79fc0cd4c0 0x7f79fc0cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48908/0 (socket says 172.21.15.113:48908) 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f79fc15ba50 0x7f79fc09ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47800/0 (socket says 172.21.15.113:47800) 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fad9d640 1 -- 172.21.15.113:0/2475984881 learned_addr learned my addr 172.21.15.113:0/2475984881 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 -- 172.21.15.113:0/2475984881 >> v2:172.21.15.152:3300/0 conn(0x7f79fc15be30 msgr2=0x7f79fc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 --2- 172.21.15.113:0/2475984881 >> v2:172.21.15.152:3300/0 conn(0x7f79fc15be30 0x7f79fc0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 -- 172.21.15.113:0/2475984881 >> v1:172.21.15.113:6789/0 conn(0x7f79fc0cd4c0 legacy=0x7f79fc0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79fa59c640 1 -- 172.21.15.113:0/2475984881 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc09a330 con 0x7f79fc15ba50 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.101+0000 7f79f9d9b640 1 -- 172.21.15.113:0/2475984881 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191286848 0 0) 0x7f79fc099d70 con 0x7f79fc0cd4c0 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f79fa59c640 1 --2- 172.21.15.113:0/2475984881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc09ab30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0cbf60 tx=0x7f79ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b247772e9aa80300 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f79f9d9b640 1 -- 172.21.15.113:0/2475984881 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec035020 con 0x7f79fc15ba50 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f79f9d9b640 1 -- 172.21.15.113:0/2475984881 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec031830 con 0x7f79fc15ba50 2024-02-26T12:19:47.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f79f9d9b640 1 -- 172.21.15.113:0/2475984881 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec031c00 con 0x7f79fc15ba50 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 -- 172.21.15.113:0/2475984881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 msgr2=0x7f79fc09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 --2- 172.21.15.113:0/2475984881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc09ab30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0cbf60 tx=0x7f79ec02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 -- 172.21.15.113:0/2475984881 shutdown_connections 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 --2- 172.21.15.113:0/2475984881 >> v2:172.21.15.152:3300/0 conn(0x7f79fc15be30 0x7f79fc0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 --2- 172.21.15.113:0/2475984881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc09ab30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 -- 172.21.15.113:0/2475984881 >> 172.21.15.113:0/2475984881 conn(0x7f79fc0b3450 msgr2=0x7f79fc0b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 -- 172.21.15.113:0/2475984881 shutdown_connections 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.102+0000 7f7a00c60640 1 -- 172.21.15.113:0/2475984881 wait complete. 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.103+0000 7f7a00c60640 1 Processor -- start 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 -- start start 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc0cd4c0 0x7f79fc14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79fc15be30 0x7f79fc14b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0d0650 con 0x7f79fc15ba50 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0cf6f0 con 0x7f79fc0cd4c0 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f7a00c60640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0d07d0 con 0x7f79fc15be30 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f79f3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47806/0 (socket says 172.21.15.113:47806) 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.104+0000 7f79f3fff640 1 -- 172.21.15.113:0/1661821328 learned_addr learned my addr 172.21.15.113:0/1661821328 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79fa59c640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc0cd4c0 0x7f79fc14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79fad9d640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79fc15be30 0x7f79fc14b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 -- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79fc15be30 msgr2=0x7f79fc14b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79fc15be30 0x7f79fc14b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 -- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc0cd4c0 msgr2=0x7f79fc14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc0cd4c0 0x7f79fc14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 -- 172.21.15.113:0/1661821328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc14bc60 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f3fff640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b410 tx=0x7f79e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4015020 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4011830 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc14bf40 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011c20 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.105+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc14c500 con 0x7f79fc15ba50 2024-02-26T12:19:47.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.106+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc074a50 con 0x7f79fc15ba50 2024-02-26T12:19:47.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.107+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79e4018020 con 0x7f79fc15ba50 2024-02-26T12:19:47.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.107+0000 7f79f2ffd640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 0x7f79dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.107+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e408a060 con 0x7f79fc15ba50 2024-02-26T12:19:47.094 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.107+0000 7f79fa59c640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 0x7f79dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.107+0000 7f79fa59c640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 0x7f79dc06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79ec036000 tx=0x7f79ec03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.111+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79e401f020 con 0x7f79fc15ba50 2024-02-26T12:19:47.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.280+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79fc070ee0 con 0x7f79fc15ba50 2024-02-26T12:19:47.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.280+0000 7f79f2ffd640 1 -- 172.21.15.113:0/1661821328 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79e4058ee0 con 0x7f79fc15ba50 2024-02-26T12:19:47.266 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 msgr2=0x7f79dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 0x7f79dc06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f79ec036000 tx=0x7f79ec03d040 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 msgr2=0x7f79fc0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b410 tx=0x7f79e400b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 shutdown_connections 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f79dc06b4d0 0x7f79dc06d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79fc15be30 0x7f79fc14b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f79fc15ba50 0x7f79fc0b1bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 --2- 172.21.15.113:0/1661821328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79fc0cd4c0 0x7f79fc14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 >> 172.21.15.113:0/1661821328 conn(0x7f79fc0b3450 msgr2=0x7f79fc0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 shutdown_connections 2024-02-26T12:19:47.268 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.282+0000 7f7a00c60640 1 -- 172.21.15.113:0/1661821328 wait complete. 2024-02-26T12:19:47.279 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-26T12:19:47.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.394+0000 7f39a015d640 1 Processor -- start 2024-02-26T12:19:47.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.394+0000 7f39a015d640 1 -- start start 2024-02-26T12:19:47.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f39a015d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f399815e100 0x7f39980b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f39a015d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399815e4e0 con 0x7f399806be70 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f39a015d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399806c6c0 con 0x7f399809a150 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f39a015d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980cbef0 con 0x7f399815e100 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f399d6f8640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f399806be70 0x7f3998099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48920/0 (socket says 172.21.15.113:48920) 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f399d6f8640 1 -- 172.21.15.113:0/2187196673 learned_addr learned my addr 172.21.15.113:0/2187196673 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.395+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> v2:172.21.15.152:3300/0 conn(0x7f399815e100 0x7f39980b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983584797 0 0) 0x7f399815e4e0 con 0x7f399806be70 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3984003520 con 0x7f399806be70 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 359519991 0 0) 0x7f3984003520 con 0x7f399806be70 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 >> v2:172.21.15.152:3300/0 conn(0x7f399815e100 msgr2=0x7f39980b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 --2- 172.21.15.113:0/2187196673 >> v2:172.21.15.152:3300/0 conn(0x7f399815e100 0x7f39980b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 >> v1:172.21.15.152:6789/0 conn(0x7f399809a150 legacy=0x7f39980cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399806c9a0 con 0x7f399806be70 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f3988001670 con 0x7f399806be70 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> v2:172.21.15.152:3300/0 conn(0x7f399815e100 0x7f39980b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 >> v1:172.21.15.113:6789/0 conn(0x7f399806be70 legacy=0x7f3998099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 0x7f3984003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3984004800 0x7f3984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840051c0 0x7f398400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39980cbef0 con 0x7f39840039b0 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400c060 con 0x7f39840051c0 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398400c260 con 0x7f3984004800 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 0x7f3984003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399e6fa640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840051c0 0x7f398400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399d6f8640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3984004800 0x7f3984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 -- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3984004800 msgr2=0x7f3984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3984004800 0x7f3984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 -- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840051c0 msgr2=0x7f398400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840051c0 0x7f398400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399def9640 1 -- 172.21.15.113:0/2187196673 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3984003520 con 0x7f39840039b0 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399e6fa640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840051c0 0x7f398400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.396+0000 7f399e6fa640 1 -- 172.21.15.113:0/2187196673 reap_dead start 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.397+0000 7f399def9640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 0x7f3984003dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f399400e350 tx=0x7f3984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950a0484b537c1de server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.397+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994039070 con 0x7f39840039b0 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.397+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399402cd70 con 0x7f39840039b0 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.397+0000 7f399cef7640 1 -- 172.21.15.113:0/2187196673 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994009de0 con 0x7f39840039b0 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 -- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 msgr2=0x7f3984003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 0x7f3984003dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f399400e350 tx=0x7f3984005830 comp rx=0 tx=0).stop 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 -- 172.21.15.113:0/2187196673 shutdown_connections 2024-02-26T12:19:47.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 --2- 172.21.15.113:0/2187196673 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39840039b0 0x7f3984003dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 -- 172.21.15.113:0/2187196673 >> 172.21.15.113:0/2187196673 conn(0x7f39980b3390 msgr2=0x7f39980b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:47.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 -- 172.21.15.113:0/2187196673 shutdown_connections 2024-02-26T12:19:47.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.398+0000 7f39a015d640 1 -- 172.21.15.113:0/2187196673 wait complete. 2024-02-26T12:19:47.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.399+0000 7f39a015d640 1 Processor -- start 2024-02-26T12:19:47.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.399+0000 7f39a015d640 1 -- start start 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 0x7f399814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f399814d620 0x7f399814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806c2f0 con 0x7f39980cab20 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399806cf60 con 0x7f39840039b0 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399806c470 con 0x7f399814d620 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47832/0 (socket says 172.21.15.113:47832) 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 -- 172.21.15.113:0/1061739954 learned_addr learned my addr 172.21.15.113:0/1061739954 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399def9640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 0x7f399814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399d6f8640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f399814d620 0x7f399814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 -- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f399814d620 msgr2=0x7f399814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f399814d620 0x7f399814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 -- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 msgr2=0x7f399814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 0x7f399814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 -- 172.21.15.113:0/1061739954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39980c9aa0 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399def9640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 0x7f399814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f399e6fa640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f399806de20 tx=0x7f399000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990019070 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900050d0 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39980c9d60 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900035f0 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.400+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39980ca320 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.401+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998074a50 con 0x7f39980cab20 2024-02-26T12:19:47.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.402+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f399001c070 con 0x7f39980cab20 2024-02-26T12:19:47.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.402+0000 7f398e7fc640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 0x7f397c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.402+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39900893a0 con 0x7f39980cab20 2024-02-26T12:19:47.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.402+0000 7f399def9640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 0x7f397c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.402+0000 7f399def9640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 0x7f397c06d9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3994036000 tx=0x7f399402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.406+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39900582b0 con 0x7f39980cab20 2024-02-26T12:19:47.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.592+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f399815e4e0 con 0x7f39980cab20 2024-02-26T12:19:47.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.592+0000 7f398e7fc640 1 -- 172.21.15.113:0/1061739954 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3990057bb0 con 0x7f39980cab20 2024-02-26T12:19:47.577 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 msgr2=0x7f397c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 0x7f397c06d9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3994036000 tx=0x7f399402e000 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 msgr2=0x7f39980cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f399806de20 tx=0x7f399000e5f0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 shutdown_connections 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f397c06b500 0x7f397c06d9c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39980cab20 0x7f39980cafa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f399814d620 0x7f399814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 --2- 172.21.15.113:0/1061739954 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39840039b0 0x7f399814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 >> 172.21.15.113:0/1061739954 conn(0x7f39980b3390 msgr2=0x7f3998070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:47.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 shutdown_connections 2024-02-26T12:19:47.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.594+0000 7f39a015d640 1 -- 172.21.15.113:0/1061739954 wait complete. 2024-02-26T12:19:47.590 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-26T12:19:47.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:47.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-26T12:19:47.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:19:47.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:47.618 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-26T12:19:47.696 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:47.696 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:47.716 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:47.716 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:47.773 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:47.773 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:47.830 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:47.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.944+0000 7f7e4dc88640 1 Processor -- start 2024-02-26T12:19:47.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e4dc88640 1 -- start start 2024-02-26T12:19:47.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e4dc88640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7e480b2d80 0x7f7e480d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e4dc88640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480d1f50 con 0x7f7e480d3530 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e4dc88640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480d2230 con 0x7f7e4815def0 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e4dc88640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e480d2510 con 0x7f7e480b2d80 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e47fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7e480d3530 0x7f7e480ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48924/0 (socket says 172.21.15.113:48924) 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.945+0000 7f7e47fff640 1 -- 172.21.15.113:0/859407069 learned_addr learned my addr 172.21.15.113:0/859407069 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e46ffd640 1 --2- 172.21.15.113:0/859407069 >> v2:172.21.15.152:3300/0 conn(0x7f7e480b2d80 0x7f7e480d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884012111 0 0) 0x7f7e480d1f50 con 0x7f7e480d3530 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e30003520 con 0x7f7e480d3530 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2131134069 0 0) 0x7f7e30003520 con 0x7f7e480d3530 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 >> v2:172.21.15.152:3300/0 conn(0x7f7e480b2d80 msgr2=0x7f7e480d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 --2- 172.21.15.113:0/859407069 >> v2:172.21.15.152:3300/0 conn(0x7f7e480b2d80 0x7f7e480d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 >> v1:172.21.15.152:6789/0 conn(0x7f7e4815def0 legacy=0x7f7e480b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480d27f0 con 0x7f7e480d3530 2024-02-26T12:19:47.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f7e400019f0 con 0x7f7e480d3530 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 >> v1:172.21.15.113:6789/0 conn(0x7f7e480d3530 legacy=0x7f7e480ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e30004800 0x7f7e30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300051c0 0x7f7e3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d2510 con 0x7f7e300039e0 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3000c090 con 0x7f7e300051c0 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3000c290 con 0x7f7e30004800 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e47fff640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300051c0 0x7f7e3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e46ffd640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e30004800 0x7f7e30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 -- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e30004800 msgr2=0x7f7e30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e30004800 0x7f7e30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 -- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300051c0 msgr2=0x7f7e3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300051c0 0x7f7e3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e477fe640 1 -- 172.21.15.113:0/859407069 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30003520 con 0x7f7e300039e0 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.946+0000 7f7e47fff640 1 -- 172.21.15.113:0/859407069 reap_dead start 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.947+0000 7f7e477fe640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e38001750 tx=0x7f7e30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa2baaa6a91a413 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.947+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38001370 con 0x7f7e300039e0 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.947+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e380052d0 con 0x7f7e300039e0 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.947+0000 7f7e467fc640 1 -- 172.21.15.113:0/859407069 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38003830 con 0x7f7e300039e0 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 -- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 msgr2=0x7f7e30003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e38001750 tx=0x7f7e30005830 comp rx=0 tx=0).stop 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 -- 172.21.15.113:0/859407069 shutdown_connections 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/859407069 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e300039e0 0x7f7e30003e00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 -- 172.21.15.113:0/859407069 >> 172.21.15.113:0/859407069 conn(0x7f7e480728b0 msgr2=0x7f7e480d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 -- 172.21.15.113:0/859407069 shutdown_connections 2024-02-26T12:19:47.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.948+0000 7f7e4dc88640 1 -- 172.21.15.113:0/859407069 wait complete. 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.949+0000 7f7e4dc88640 1 Processor -- start 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.949+0000 7f7e4dc88640 1 -- start start 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 0x7f7e4815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e481e9350 0x7f7e481e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d3170 con 0x7f7e480b8300 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d2ff0 con 0x7f7e300039e0 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e4dc88640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480d32f0 con 0x7f7e481e9350 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47852/0 (socket says 172.21.15.113:47852) 2024-02-26T12:19:47.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 -- 172.21.15.113:0/1053142190 learned_addr learned my addr 172.21.15.113:0/1053142190 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e477fe640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 0x7f7e4815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e46ffd640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e481e9350 0x7f7e481e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 -- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e481e9350 msgr2=0x7f7e481e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e481e9350 0x7f7e481e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 -- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 msgr2=0x7f7e4815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 0x7f7e4815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 -- 172.21.15.113:0/1053142190 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e481e7790 con 0x7f7e480b8300 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e477fe640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 0x7f7e4815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.950+0000 7f7e47fff640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e480b91c0 tx=0x7f7e40007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.951+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000abc0 con 0x7f7e480b8300 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.951+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e40018070 con 0x7f7e480b8300 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.951+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e481e7a70 con 0x7f7e480b8300 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.951+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400133f0 con 0x7f7e480b8300 2024-02-26T12:19:47.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.951+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e481e8030 con 0x7f7e480b8300 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.952+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e48074a50 con 0x7f7e480b8300 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.952+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e40013590 con 0x7f7e480b8300 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.952+0000 7f7e2ffff640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 0x7f7e3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.953+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e4008a7a0 con 0x7f7e480b8300 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.953+0000 7f7e477fe640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 0x7f7e3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:47.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.953+0000 7f7e477fe640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 0x7f7e3406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7e38033000 tx=0x7f7e38009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:47.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:47.957+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e40059590 con 0x7f7e480b8300 2024-02-26T12:19:48.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.126+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e480b7de0 con 0x7f7e480b8300 2024-02-26T12:19:48.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.127+0000 7f7e2ffff640 1 -- 172.21.15.113:0/1053142190 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f7e40058e90 con 0x7f7e480b8300 2024-02-26T12:19:48.113 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:48.113 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 msgr2=0x7f7e3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 0x7f7e3406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7e38033000 tx=0x7f7e38009030 comp rx=0 tx=0).stop 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 msgr2=0x7f7e480b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e480b91c0 tx=0x7f7e40007a90 comp rx=0 tx=0).stop 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 shutdown_connections 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e3406b500 0x7f7e3406d9c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e480b8300 0x7f7e480b87b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e481e9350 0x7f7e481e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.115 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 --2- 172.21.15.113:0/1053142190 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e300039e0 0x7f7e4815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 >> 172.21.15.113:0/1053142190 conn(0x7f7e480728b0 msgr2=0x7f7e480ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.129+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 shutdown_connections 2024-02-26T12:19:48.116 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.130+0000 7f7e4dc88640 1 -- 172.21.15.113:0/1053142190 wait complete. 2024-02-26T12:19:48.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:48.126 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:48.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.246+0000 7f3a0e884640 1 Processor -- start 2024-02-26T12:19:48.231 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.246+0000 7f3a0e884640 1 -- start start 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0e884640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 0x7f3a080b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0e884640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0815e620 con 0x7f3a0806b110 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0e884640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0815e900 con 0x7f3a080cfb70 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0e884640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080ce750 con 0x7f3a080b0360 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a07fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3a0806b110 0x7f3a080b18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:48932/0 (socket says 172.21.15.113:48932) 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a07fff640 1 -- 172.21.15.113:0/3052497268 learned_addr learned my addr 172.21.15.113:0/3052497268 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0ce21640 1 --2- 172.21.15.113:0/3052497268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 0x7f3a080b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556942153 0 0) 0x7f3a0815e620 con 0x7f3a0806b110 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f0003520 con 0x7f3a0806b110 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795586087 0 0) 0x7f3a0815e900 con 0x7f3a080cfb70 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a0815e620 con 0x7f3a080cfb70 2024-02-26T12:19:48.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0ce21640 1 -- 172.21.15.113:0/3052497268 >> v1:172.21.15.152:6789/0 conn(0x7f3a080cfb70 legacy=0x7f3a080d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0ce21640 1 -- 172.21.15.113:0/3052497268 >> v1:172.21.15.113:6789/0 conn(0x7f3a0806b110 legacy=0x7f3a080b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.247+0000 7f3a0ce21640 1 -- 172.21.15.113:0/3052497268 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0815ebe0 con 0x7f3a080b0360 2024-02-26T12:19:48.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.248+0000 7f3a0ce21640 1 --2- 172.21.15.113:0/3052497268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 0x7f3a080b07f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009dc0 tx=0x7f3a0002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243d9d76016411f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.248+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00039070 con 0x7f3a080b0360 2024-02-26T12:19:48.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.248+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0002cbb0 con 0x7f3a080b0360 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.248+0000 7f3a06ffd640 1 -- 172.21.15.113:0/3052497268 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00034440 con 0x7f3a080b0360 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 -- 172.21.15.113:0/3052497268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 msgr2=0x7f3a080b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 --2- 172.21.15.113:0/3052497268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 0x7f3a080b07f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009dc0 tx=0x7f3a0002be00 comp rx=0 tx=0).stop 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 -- 172.21.15.113:0/3052497268 shutdown_connections 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 --2- 172.21.15.113:0/3052497268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080b0360 0x7f3a080b07f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 -- 172.21.15.113:0/3052497268 >> 172.21.15.113:0/3052497268 conn(0x7f3a08099a40 msgr2=0x7f3a080d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 -- 172.21.15.113:0/3052497268 shutdown_connections 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.249+0000 7f3a0e884640 1 -- 172.21.15.113:0/3052497268 wait complete. 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.250+0000 7f3a0e884640 1 Processor -- start 2024-02-26T12:19:48.236 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.250+0000 7f3a0e884640 1 -- start start 2024-02-26T12:19:48.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 0x7f3a080ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 0x7f3a08160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080b1fc0 con 0x7f3a080b0360 2024-02-26T12:19:48.239 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0806b4f0 con 0x7f3a0806b110 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0e884640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080b2140 con 0x7f3a080cfb70 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a077fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:47862/0 (socket says 172.21.15.113:47862) 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a077fe640 1 -- 172.21.15.113:0/805177835 learned_addr learned my addr 172.21.15.113:0/805177835 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a07fff640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 0x7f3a080ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.251+0000 7f3a0ce21640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 0x7f3a08160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 -- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 msgr2=0x7f3a08160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 0x7f3a08160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.240 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 -- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 msgr2=0x7f3a080ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 0x7f3a080ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 -- 172.21.15.113:0/805177835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080b39f0 con 0x7f3a080b0360 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a0ce21640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 0x7f3a08160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a07fff640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 0x7f3a080ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a077fe640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39f800c530 tx=0x7f39f800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80052d0 con 0x7f3a080b0360 2024-02-26T12:19:48.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8005490 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080b3cd0 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8012870 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.252+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080b4290 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.253+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08068180 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.253+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39f8012a10 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.254+0000 7f3a04ff9640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 0x7f39f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.254+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39f8089f40 con 0x7f3a080b0360 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.254+0000 7f3a07fff640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 0x7f39f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.254+0000 7f3a07fff640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 0x7f39f406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0011e0 tx=0x7f39fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.258+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39f8058dd0 con 0x7f3a080b0360 2024-02-26T12:19:48.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.436+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a080b67d0 con 0x7f3a080b0360 2024-02-26T12:19:48.421 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.436+0000 7f3a04ff9640 1 -- 172.21.15.113:0/805177835 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39f80586d0 con 0x7f3a080b0360 2024-02-26T12:19:48.422 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 msgr2=0x7f39f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 0x7f39f406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0011e0 tx=0x7f39fc009040 comp rx=0 tx=0).stop 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 msgr2=0x7f3a0815a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39f800c530 tx=0x7f39f800c9f0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 shutdown_connections 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f39f406b4d0 0x7f39f406d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a080cfb70 0x7f3a08160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a080b0360 0x7f3a0815a6c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.424 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 --2- 172.21.15.113:0/805177835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a0806b110 0x7f3a080ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.438+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 >> 172.21.15.113:0/805177835 conn(0x7f3a08099a40 msgr2=0x7f3a080ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.439+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 shutdown_connections 2024-02-26T12:19:48.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.439+0000 7f3a0e884640 1 -- 172.21.15.113:0/805177835 wait complete. 2024-02-26T12:19:48.434 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:48.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.557+0000 7fecae491640 1 Processor -- start 2024-02-26T12:19:48.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.557+0000 7fecae491640 1 -- start start 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecae491640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feca80cfb70 0x7feca80d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecae491640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca815e620 con 0x7feca815d4d0 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecae491640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca815e900 con 0x7feca806b110 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecae491640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80ce750 con 0x7feca80cfb70 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecaca2e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7feca815d4d0 0x7feca815d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51120/0 (socket says 172.21.15.113:51120) 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7fecaca2e640 1 -- 172.21.15.113:0/49807350 learned_addr learned my addr 172.21.15.113:0/49807350 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca77fe640 1 --2- 172.21.15.113:0/49807350 >> v2:172.21.15.152:3300/0 conn(0x7feca80cfb70 0x7feca80d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889755991 0 0) 0x7feca815e620 con 0x7feca815d4d0 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec90003520 con 0x7feca815d4d0 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca77fe640 1 -- 172.21.15.113:0/49807350 >> v1:172.21.15.152:6789/0 conn(0x7feca806b110 legacy=0x7feca80b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca77fe640 1 -- 172.21.15.113:0/49807350 >> v1:172.21.15.113:6789/0 conn(0x7feca815d4d0 legacy=0x7feca815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260987799 0 0) 0x7fec90003520 con 0x7feca815d4d0 2024-02-26T12:19:48.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.558+0000 7feca77fe640 1 -- 172.21.15.113:0/49807350 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca815ebe0 con 0x7feca80cfb70 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.559+0000 7feca77fe640 1 --2- 172.21.15.113:0/49807350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca80d0020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec980097a0 tx=0x7fec9802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a144144c74137493 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.559+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98037070 con 0x7feca80cfb70 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.559+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98030510 con 0x7feca80cfb70 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.559+0000 7feca6ffd640 1 -- 172.21.15.113:0/49807350 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00019f0 con 0x7feca80cfb70 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 -- 172.21.15.113:0/49807350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 msgr2=0x7feca80d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 --2- 172.21.15.113:0/49807350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca80d0020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fec980097a0 tx=0x7fec9802b710 comp rx=0 tx=0).stop 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 -- 172.21.15.113:0/49807350 shutdown_connections 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 --2- 172.21.15.113:0/49807350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca80d0020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 -- 172.21.15.113:0/49807350 >> 172.21.15.113:0/49807350 conn(0x7feca8099a40 msgr2=0x7feca80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 -- 172.21.15.113:0/49807350 shutdown_connections 2024-02-26T12:19:48.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.560+0000 7fecae491640 1 -- 172.21.15.113:0/49807350 wait complete. 2024-02-26T12:19:48.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.561+0000 7fecae491640 1 Processor -- start 2024-02-26T12:19:48.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 -- start start 2024-02-26T12:19:48.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feca806b110 0x7feca80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca806b4f0 con 0x7feca815d4d0 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80d0560 con 0x7feca80cfb70 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecae491640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80b1fc0 con 0x7feca806b110 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecaca2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecaca2e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52944/0 (socket says 172.21.15.113:52944) 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.562+0000 7fecaca2e640 1 -- 172.21.15.113:0/2027187827 learned_addr learned my addr 172.21.15.113:0/2027187827 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7feca77fe640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 -- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feca806b110 msgr2=0x7feca80b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feca806b110 0x7feca80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 -- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 msgr2=0x7feca815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 -- 172.21.15.113:0/2027187827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8158ee0 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7feca77fe640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecaca2e640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feca0001f50 tx=0x7feca000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0012400 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00125a0 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca81591c0 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0012990 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.563+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca8159780 con 0x7feca815d4d0 2024-02-26T12:19:48.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.564+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca8068180 con 0x7feca815d4d0 2024-02-26T12:19:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.565+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feca0012b30 con 0x7feca815d4d0 2024-02-26T12:19:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.565+0000 7feca4ff9640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 0x7fec9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.565+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feca008aa80 con 0x7feca815d4d0 2024-02-26T12:19:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.565+0000 7feca7fff640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 0x7fec9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.566+0000 7feca7fff640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 0x7fec9406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000f60 tx=0x7fec9c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.570+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feca0012e20 con 0x7feca815d4d0 2024-02-26T12:19:48.563 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:19:48.566 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:19:48.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.749+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feca80ce8d0 con 0x7feca815d4d0 2024-02-26T12:19:48.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.750+0000 7feca4ff9640 1 -- 172.21.15.113:0/2027187827 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca80ce8d0 con 0x7feca815d4d0 2024-02-26T12:19:48.735 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:48.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 msgr2=0x7fec9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 0x7fec9406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec9c000f60 tx=0x7fec9c0079d0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 msgr2=0x7feca8154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feca0001f50 tx=0x7feca000a430 comp rx=0 tx=0).stop 2024-02-26T12:19:48.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 shutdown_connections 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fec9406b4d0 0x7fec9406d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7feca815d4d0 0x7feca8154ce0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feca80cfb70 0x7feca815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 --2- 172.21.15.113:0/2027187827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feca806b110 0x7feca80b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 >> 172.21.15.113:0/2027187827 conn(0x7feca8099a40 msgr2=0x7feca80b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 shutdown_connections 2024-02-26T12:19:48.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.752+0000 7fecae491640 1 -- 172.21.15.113:0/2027187827 wait complete. 2024-02-26T12:19:48.748 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:48.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.867+0000 7f1e8400f640 1 Processor -- start 2024-02-26T12:19:48.853 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 -- start start 2024-02-26T12:19:48.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1e7c15de30 0x7f1e7c0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e7c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0d1dc0 con 0x7f1e7c0ce930 2024-02-26T12:19:48.856 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0b5fb0 con 0x7f1e7c15de30 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.868+0000 7f1e8400f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cedc0 con 0x7f1e7c0b5b50 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e825ac640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f1e7c0ce930 0x7f1e7c06c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51136/0 (socket says 172.21.15.113:51136) 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e825ac640 1 -- 172.21.15.113:0/1366336881 learned_addr learned my addr 172.21.15.113:0/1366336881 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274415265 0 0) 0x7f1e7c0d1dc0 con 0x7f1e7c0ce930 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e81dab640 1 --2- 172.21.15.113:0/1366336881 >> v2:172.21.15.152:3300/0 conn(0x7f1e7c15de30 0x7f1e7c0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e68003520 con 0x7f1e7c0ce930 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e815aa640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e7c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893323663 0 0) 0x7f1e68003520 con 0x7f1e7c0ce930 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 msgr2=0x7f1e7c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e7c0ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 >> v2:172.21.15.152:3300/0 conn(0x7f1e7c15de30 msgr2=0x7f1e7c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 --2- 172.21.15.113:0/1366336881 >> v2:172.21.15.152:3300/0 conn(0x7f1e7c15de30 0x7f1e7c0b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0cf000 con 0x7f1e7c0ce930 2024-02-26T12:19:48.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f1e740019f0 con 0x7f1e7c0ce930 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 >> v1:172.21.15.113:6789/0 conn(0x7f1e7c0ce930 legacy=0x7f1e7c06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e68003f30 0x7f1e68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cedc0 con 0x7f1e68004d40 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6800b9c0 con 0x7f1e68003f30 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6800bb40 con 0x7f1e7c0b5b50 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e825ac640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e815aa640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e68003f30 0x7f1e68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.869+0000 7f1e81dab640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 -- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 msgr2=0x7f1e680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b5b50 0x7f1e680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 -- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e68003f30 msgr2=0x7f1e68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:48.858 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e68003f30 0x7f1e68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 -- 172.21.15.113:0/1366336881 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68003520 con 0x7f1e68004d40 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e815aa640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e68003f30 0x7f1e68004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e825ac640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400a870 tx=0x7f1e68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56de9f6a87eef3fd server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.870+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400a4c0 con 0x7f1e68004d40 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74034630 con 0x7f1e68004d40 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e80da9640 1 -- 172.21.15.113:0/1366336881 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74034a20 con 0x7f1e68004d40 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 -- 172.21.15.113:0/1366336881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e68004d40 msgr2=0x7f1e680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 --2- 172.21.15.113:0/1366336881 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e68004d40 0x7f1e680051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400a870 tx=0x7f1e68005830 comp rx=0 tx=0).stop 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e825ac640 1 -- 172.21.15.113:0/1366336881 reap_dead start 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 -- 172.21.15.113:0/1366336881 shutdown_connections 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 -- 172.21.15.113:0/1366336881 >> 172.21.15.113:0/1366336881 conn(0x7f1e7c0d0610 msgr2=0x7f1e7c0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 -- 172.21.15.113:0/1366336881 shutdown_connections 2024-02-26T12:19:48.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.871+0000 7f1e8400f640 1 -- 172.21.15.113:0/1366336881 wait complete. 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.872+0000 7f1e8400f640 1 Processor -- start 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.872+0000 7f1e8400f640 1 -- start start 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 0x7f1e7c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e7c0b82c0 0x7f1e7c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0d2340 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c161d50 con 0x7f1e7c0b82c0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e8400f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0b6dc0 con 0x7f1e7c0b7ee0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52970/0 (socket says 172.21.15.113:52970) 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 -- 172.21.15.113:0/3471379970 learned_addr learned my addr 172.21.15.113:0/3471379970 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e81dab640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 0x7f1e7c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 -- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 msgr2=0x7f1e7c0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 0x7f1e7c0cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 -- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e7c0b82c0 msgr2=0x7f1e7c0cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.873+0000 7f1e825ac640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e7c0b82c0 0x7f1e7c0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e825ac640 1 -- 172.21.15.113:0/3471379970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0ccf00 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e81dab640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 0x7f1e7c0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e825ac640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400a0b0 tx=0x7f1e7c0b6b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74039040 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74043070 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c0cd1e0 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400a4c0 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.874+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c0cd7a0 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.875+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c074a50 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.875+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e74034a00 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.876+0000 7f1e6e7fc640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 0x7f1e6006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.876+0000 7f1e81dab640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 0x7f1e6006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.876+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e740ac100 con 0x7f1e7c0cb1a0 2024-02-26T12:19:48.864 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.876+0000 7f1e81dab640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 0x7f1e6006d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009b30 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:48.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:48.884+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e7407b130 con 0x7f1e7c0cb1a0 2024-02-26T12:19:49.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.056+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e7c0d18d0 con 0x7f1e7c0cb1a0 2024-02-26T12:19:49.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.056+0000 7f1e6e7fc640 1 -- 172.21.15.113:0/3471379970 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e7407aa30 con 0x7f1e7c0cb1a0 2024-02-26T12:19:49.042 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 msgr2=0x7f1e6006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 0x7f1e6006d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009b30 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 msgr2=0x7f1e7c0cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400a0b0 tx=0x7f1e7c0b6b70 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 shutdown_connections 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f1e6006b500 0x7f1e6006d9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e7c0cb1a0 0x7f1e7c0cb650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e7c0b82c0 0x7f1e7c0cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 --2- 172.21.15.113:0/3471379970 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1e7c0b7ee0 0x7f1e7c0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 >> 172.21.15.113:0/3471379970 conn(0x7f1e7c0d0610 msgr2=0x7f1e7c0b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:49.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 shutdown_connections 2024-02-26T12:19:49.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.058+0000 7f1e8400f640 1 -- 172.21.15.113:0/3471379970 wait complete. 2024-02-26T12:19:49.054 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-26T12:19:49.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.170+0000 7fc10f7c8640 1 Processor -- start 2024-02-26T12:19:49.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.170+0000 7fc10f7c8640 1 -- start start 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.171+0000 7fc10f7c8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1080cca10 0x7fc10806ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.171+0000 7fc10f7c8640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10806b5d0 con 0x7fc10815efd0 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.171+0000 7fc10f7c8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10815e530 con 0x7fc1080cfc30 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.171+0000 7fc10f7c8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080ce750 con 0x7fc1080cca10 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10cd63640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc1080cca10 0x7fc10806ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10dd65640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc10815efd0 0x7fc108161940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51138/0 (socket says 172.21.15.113:51138) 2024-02-26T12:19:49.157 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10dd65640 1 -- 172.21.15.113:0/622003824 learned_addr learned my addr 172.21.15.113:0/622003824 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:49.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10cd63640 1 -- 172.21.15.113:0/622003824 >> v1:172.21.15.152:6789/0 conn(0x7fc1080cfc30 legacy=0x7fc1080d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10cd63640 1 -- 172.21.15.113:0/622003824 >> v1:172.21.15.113:6789/0 conn(0x7fc10815efd0 legacy=0x7fc108161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc0fffff640 1 -- 172.21.15.113:0/622003824 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391567570 0 0) 0x7fc10806b5d0 con 0x7fc10815efd0 2024-02-26T12:19:49.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.172+0000 7fc10cd63640 1 -- 172.21.15.113:0/622003824 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10806b2f0 con 0x7fc1080cca10 2024-02-26T12:19:49.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.173+0000 7fc10cd63640 1 --2- 172.21.15.113:0/622003824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc10806ab50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1040097a0 tx=0x7fc10402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f462fa1d4a9fc26 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.173+0000 7fc0fffff640 1 -- 172.21.15.113:0/622003824 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040315a0 con 0x7fc1080cca10 2024-02-26T12:19:49.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.173+0000 7fc0fffff640 1 -- 172.21.15.113:0/622003824 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104037070 con 0x7fc1080cca10 2024-02-26T12:19:49.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.173+0000 7fc0fffff640 1 -- 172.21.15.113:0/622003824 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104031960 con 0x7fc1080cca10 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 -- 172.21.15.113:0/622003824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 msgr2=0x7fc10806ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/622003824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc10806ab50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc1040097a0 tx=0x7fc10402b840 comp rx=0 tx=0).stop 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 -- 172.21.15.113:0/622003824 shutdown_connections 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/622003824 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc10806ab50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 -- 172.21.15.113:0/622003824 >> 172.21.15.113:0/622003824 conn(0x7fc108099a40 msgr2=0x7fc1080d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 -- 172.21.15.113:0/622003824 shutdown_connections 2024-02-26T12:19:49.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.174+0000 7fc10f7c8640 1 -- 172.21.15.113:0/622003824 wait complete. 2024-02-26T12:19:49.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.175+0000 7fc10f7c8640 1 Processor -- start 2024-02-26T12:19:49.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.175+0000 7fc10f7c8640 1 -- start start 2024-02-26T12:19:49.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 0x7fc108153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.162 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 0x7fc1081615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10806b090 con 0x7fc1080cca10 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10815eb40 con 0x7fc1080cfc30 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10f7c8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10815e0c0 con 0x7fc10815efd0 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52996/0 (socket says 172.21.15.113:52996) 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 -- 172.21.15.113:0/3234073679 learned_addr learned my addr 172.21.15.113:0/3234073679 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10dd65640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 0x7fc1081615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10cd63640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 0x7fc108153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 -- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 msgr2=0x7fc1081615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 0x7fc1081615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 -- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 msgr2=0x7fc108153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 0x7fc108153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10d564640 1 -- 172.21.15.113:0/3234073679 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080c86d0 con 0x7fc1080cca10 2024-02-26T12:19:49.163 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10cd63640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 0x7fc108153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.176+0000 7fc10dd65640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 0x7fc1081615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc10d564640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c480 tx=0x7fc0f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80052d0 con 0x7fc1080cca10 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8005470 con 0x7fc1080cca10 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8012870 con 0x7fc1080cca10 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080c89b0 con 0x7fc1080cca10 2024-02-26T12:19:49.164 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.177+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080c8f70 con 0x7fc1080cca10 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.178+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108068180 con 0x7fc1080cca10 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.178+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc0f8012a10 con 0x7fc1080cca10 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.179+0000 7fc0fdffb640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 0x7fc0ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.179+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0f8089e00 con 0x7fc1080cca10 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.179+0000 7fc10cd63640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 0x7fc0ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.165 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.179+0000 7fc10cd63640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 0x7fc0ec06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc104036000 tx=0x7fc10403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.183+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0f8058d10 con 0x7fc1080cca10 2024-02-26T12:19:49.353 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.368+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1080c92e0 con 0x7fc1080cca10 2024-02-26T12:19:49.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.368+0000 7fc0fdffb640 1 -- 172.21.15.113:0/3234073679 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0f8058610 con 0x7fc1080cca10 2024-02-26T12:19:49.354 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.370+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 msgr2=0x7fc0ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.370+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 0x7fc0ec06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc104036000 tx=0x7fc10403d040 comp rx=0 tx=0).stop 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.370+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 msgr2=0x7fc1081539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.370+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c480 tx=0x7fc0f800c940 comp rx=0 tx=0).stop 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 shutdown_connections 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc0ec06b4d0 0x7fc0ec06d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.356 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc10815efd0 0x7fc1081615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1080cfc30 0x7fc108153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 --2- 172.21.15.113:0/3234073679 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc1080cca10 0x7fc1081539d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 >> 172.21.15.113:0/3234073679 conn(0x7fc108099a40 msgr2=0x7fc1080d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 shutdown_connections 2024-02-26T12:19:49.357 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.371+0000 7fc10f7c8640 1 -- 172.21.15.113:0/3234073679 wait complete. 2024-02-26T12:19:49.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-26T12:19:49.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:49.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-02-26T12:19:49.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:19:49.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:49.400 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-26T12:19:49.469 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:49.470 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:49.485 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:49.485 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:49.541 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:19:49.541 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:49.596 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:49.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 Processor -- start 2024-02-26T12:19:49.737 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 -- start start 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5cdc15def0 0x7f5cdc0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc0b2d80 0x7f5cdc0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 0x7f5cdc0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0d1f50 con 0x7f5cdc15def0 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0d2230 con 0x7f5cdc0d3530 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.752+0000 7f5ce1cc8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0d2510 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5cdc15def0 0x7f5cdc0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5cdc15def0 0x7f5cdc0b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53002/0 (socket says 172.21.15.113:53002) 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2354603498 learned_addr learned my addr 172.21.15.113:0/2354603498 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdbfff640 1 --2- 172.21.15.113:0/2354603498 >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 0x7f5cdc0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdaffd640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc0b2d80 0x7f5cdc0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2354603498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc0b2d80 msgr2=0x7f5cdc0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc0b2d80 0x7f5cdc0d2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2354603498 >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 msgr2=0x7f5cdc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2354603498 >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 0x7f5cdc0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2354603498 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0d27f0 con 0x7f5cdc15def0 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.753+0000 7f5cdbfff640 1 --2- 172.21.15.113:0/2354603498 >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 0x7f5cdc0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc15def0 0x7f5cdc0b9400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b6630 tx=0x7f5ccc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3f273d595631fb server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5cda7fc640 1 -- 172.21.15.113:0/2354603498 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc035020 con 0x7f5cdc15def0 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5cda7fc640 1 -- 172.21.15.113:0/2354603498 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc031870 con 0x7f5cdc15def0 2024-02-26T12:19:49.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5cda7fc640 1 -- 172.21.15.113:0/2354603498 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc031c40 con 0x7f5cdc15def0 2024-02-26T12:19:49.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2354603498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc15def0 msgr2=0x7f5cdc0b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc15def0 0x7f5cdc0b9400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b6630 tx=0x7f5ccc02b910 comp rx=0 tx=0).stop 2024-02-26T12:19:49.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2354603498 shutdown_connections 2024-02-26T12:19:49.743 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2354603498 >> v2:172.21.15.152:3300/0 conn(0x7f5cdc0d3530 0x7f5cdc0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc0b2d80 0x7f5cdc0d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2354603498 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc15def0 0x7f5cdc0b9400 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2354603498 >> 172.21.15.113:0/2354603498 conn(0x7f5cdc0728b0 msgr2=0x7f5cdc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2354603498 shutdown_connections 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.754+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2354603498 wait complete. 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 Processor -- start 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 -- start start 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 0x7f5cdc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 0x7f5cdc1f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b9ac0 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b9940 con 0x7f5cdc0d3530 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.756+0000 7f5ce1cc8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0cedf0 con 0x7f5cdc15e820 2024-02-26T12:19:49.744 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53008/0 (socket says 172.21.15.113:53008) 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2364636024 learned_addr learned my addr 172.21.15.113:0/2364636024 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdaffd640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 0x7f5cdc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdbfff640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 0x7f5cdc1f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 msgr2=0x7f5cdc1f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 0x7f5cdc1f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 msgr2=0x7f5cdc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 0x7f5cdc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 -- 172.21.15.113:0/2364636024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc15ed30 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdaffd640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 0x7f5cdc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdbfff640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 0x7f5cdc1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cdb7fe640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc000c00 tx=0x7f5ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc03ad60 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0443f0 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.745 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0447e0 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc15f010 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.757+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc15f5d0 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.758+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc074a50 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.759+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ccc04b060 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.759+0000 7f5cc3fff640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 0x7f5cc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:49.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.759+0000 7f5cdaffd640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 0x7f5cc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:49.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.759+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ccc0ac370 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.760+0000 7f5cdaffd640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 0x7f5cc806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006fd0 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:49.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.764+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ccc03f070 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.936+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cdc0008d0 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.937+0000 7f5cc3fff640 1 -- 172.21.15.113:0/2364636024 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f5ccc02f320 con 0x7f5cdc0b2d80 2024-02-26T12:19:49.922 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:49.923 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 msgr2=0x7f5cc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 0x7f5cc806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006fd0 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 msgr2=0x7f5cdc1f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc000c00 tx=0x7f5ccc0046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 shutdown_connections 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f5cc806b4d0 0x7f5cc806d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5cdc15e820 0x7f5cdc1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5cdc0d3530 0x7f5cdc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 --2- 172.21.15.113:0/2364636024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5cdc0b2d80 0x7f5cdc1f6390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 >> 172.21.15.113:0/2364636024 conn(0x7f5cdc0728b0 msgr2=0x7f5cdc0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.939+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 shutdown_connections 2024-02-26T12:19:49.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:49.940+0000 7f5ce1cc8640 1 -- 172.21.15.113:0/2364636024 wait complete. 2024-02-26T12:19:49.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:49.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.053+0000 7f4d02d68640 1 Processor -- start 2024-02-26T12:19:50.039 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.053+0000 7f4d02d68640 1 -- start start 2024-02-26T12:19:50.040 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4d02d68640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4cfc0d13e0 0x7f4cfc161a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4d02d68640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 0x7f4cfc15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4d02d68640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc162050 con 0x7f4cfc099cb0 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4d02d68640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0cff40 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4d02d68640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc162330 con 0x7f4cfc09a090 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4cfbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4cfc0d13e0 0x7f4cfc161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4cfbfff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4cfc0d13e0 0x7f4cfc161a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53018/0 (socket says 172.21.15.113:53018) 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.054+0000 7f4cfbfff640 1 -- 172.21.15.113:0/3400043492 learned_addr learned my addr 172.21.15.113:0/3400043492 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4d01305640 1 --2- 172.21.15.113:0/3400043492 >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 0x7f4cfc15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4cfbfff640 1 -- 172.21.15.113:0/3400043492 >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 msgr2=0x7f4cfc15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4cfbfff640 1 --2- 172.21.15.113:0/3400043492 >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 0x7f4cfc15dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4cfbfff640 1 -- 172.21.15.113:0/3400043492 >> v1:172.21.15.152:6789/0 conn(0x7f4cfc099cb0 legacy=0x7f4cfc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4cfbfff640 1 -- 172.21.15.113:0/3400043492 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc162610 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.041 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4d01305640 1 --2- 172.21.15.113:0/3400043492 >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 0x7f4cfc15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.055+0000 7f4cfbfff640 1 --2- 172.21.15.113:0/3400043492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc0d13e0 0x7f4cfc161a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0b41c0 tx=0x7f4cf002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222d172c73e4dd12 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4cfb7fe640 1 -- 172.21.15.113:0/3400043492 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0034070 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4cfb7fe640 1 -- 172.21.15.113:0/3400043492 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf0030860 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.042 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4cfb7fe640 1 -- 172.21.15.113:0/3400043492 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0030c30 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 -- 172.21.15.113:0/3400043492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc0d13e0 msgr2=0x7f4cfc161a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 --2- 172.21.15.113:0/3400043492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc0d13e0 0x7f4cfc161a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0b41c0 tx=0x7f4cf002b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 -- 172.21.15.113:0/3400043492 shutdown_connections 2024-02-26T12:19:50.044 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 --2- 172.21.15.113:0/3400043492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc0d13e0 0x7f4cfc161a70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 --2- 172.21.15.113:0/3400043492 >> v2:172.21.15.152:3300/0 conn(0x7f4cfc09a090 0x7f4cfc15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 -- 172.21.15.113:0/3400043492 >> 172.21.15.113:0/3400043492 conn(0x7f4cfc0b34b0 msgr2=0x7f4cfc0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 -- 172.21.15.113:0/3400043492 shutdown_connections 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.056+0000 7f4d02d68640 1 -- 172.21.15.113:0/3400043492 wait complete. 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.057+0000 7f4d02d68640 1 Processor -- start 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.057+0000 7f4d02d68640 1 -- start start 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cfc099cb0 0x7f4cfc0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cfc0d13e0 0x7f4cfc155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc15e300 con 0x7f4cfc09a090 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc15e180 con 0x7f4cfc099cb0 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d02d68640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc15e480 con 0x7f4cfc0d13e0 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.045 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4cfbfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53026/0 (socket says 172.21.15.113:53026) 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4cfbfff640 1 -- 172.21.15.113:0/2014613112 learned_addr learned my addr 172.21.15.113:0/2014613112 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d01305640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cfc0d13e0 0x7f4cfc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.058+0000 7f4d00b04640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cfc099cb0 0x7f4cfc0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 -- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cfc0d13e0 msgr2=0x7f4cfc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cfc0d13e0 0x7f4cfc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 -- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cfc099cb0 msgr2=0x7f4cfc0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cfc099cb0 0x7f4cfc0ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 -- 172.21.15.113:0/2014613112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0aeb90 con 0x7f4cfc09a090 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cfbfff640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4cf002b9e0 tx=0x7f4cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0034040 con 0x7f4cfc09a090 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf003ad20 con 0x7f4cfc09a090 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0044610 con 0x7f4cfc09a090 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc0aee70 con 0x7f4cfc09a090 2024-02-26T12:19:50.046 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.059+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0af430 con 0x7f4cfc09a090 2024-02-26T12:19:50.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.060+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc074a50 con 0x7f4cfc09a090 2024-02-26T12:19:50.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.060+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4cf004b060 con 0x7f4cfc09a090 2024-02-26T12:19:50.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.061+0000 7f4cf97fa640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 0x7f4ce806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.061+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cf00ac2d0 con 0x7f4cfc09a090 2024-02-26T12:19:50.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.061+0000 7f4d00b04640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 0x7f4ce806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.061+0000 7f4d00b04640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 0x7f4ce806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001640 tx=0x7f4cec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.050 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.065+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4cf003f070 con 0x7f4cfc09a090 2024-02-26T12:19:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.236+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4cfc161340 con 0x7f4cfc09a090 2024-02-26T12:19:50.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.236+0000 7f4cf97fa640 1 -- 172.21.15.113:0/2014613112 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cf0037360 con 0x7f4cfc09a090 2024-02-26T12:19:50.221 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 msgr2=0x7f4ce806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 0x7f4ce806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001640 tx=0x7f4cec009040 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 msgr2=0x7f4cfc0c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4cf002b9e0 tx=0x7f4cf00046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 shutdown_connections 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4ce806b4d0 0x7f4ce806d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cfc0d13e0 0x7f4cfc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4cfc09a090 0x7f4cfc0c7450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 --2- 172.21.15.113:0/2014613112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cfc099cb0 0x7f4cfc0ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 >> 172.21.15.113:0/2014613112 conn(0x7f4cfc0b34b0 msgr2=0x7f4cfc0b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 shutdown_connections 2024-02-26T12:19:50.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.238+0000 7f4d02d68640 1 -- 172.21.15.113:0/2014613112 wait complete. 2024-02-26T12:19:50.234 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:50.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.352+0000 7fbb5d1aa640 1 Processor -- start 2024-02-26T12:19:50.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.352+0000 7fbb5d1aa640 1 -- start start 2024-02-26T12:19:50.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5d1aa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb58071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5d1aa640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb580b3d80 0x7fbb58071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5d1aa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580ced10 con 0x7fbb5806ddb0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5d1aa640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb580b2890 con 0x7fbb580b3d80 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5d1aa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580cefb0 con 0x7fbb5815bbf0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5659c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbb5806ddb0 0x7fbb580cd250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51148/0 (socket says 172.21.15.113:51148) 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5659c640 1 -- 172.21.15.113:0/813288128 learned_addr learned my addr 172.21.15.113:0/813288128 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb56d9d640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb58071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb5759e640 1 --2- 172.21.15.113:0/813288128 >> v2:172.21.15.152:3300/0 conn(0x7fbb580b3d80 0x7fbb58071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257057086 0 0) 0x7fbb580ced10 con 0x7fbb5806ddb0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb40003520 con 0x7fbb5806ddb0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716073464 0 0) 0x7fbb40003520 con 0x7fbb5806ddb0 2024-02-26T12:19:50.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 msgr2=0x7fbb58071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb58071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 >> v2:172.21.15.152:3300/0 conn(0x7fbb580b3d80 msgr2=0x7fbb58071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.353+0000 7fbb55d9b640 1 --2- 172.21.15.113:0/813288128 >> v2:172.21.15.152:3300/0 conn(0x7fbb580b3d80 0x7fbb58071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580cf290 con 0x7fbb5806ddb0 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fbb4c001670 con 0x7fbb5806ddb0 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 >> v1:172.21.15.113:6789/0 conn(0x7fbb5806ddb0 legacy=0x7fbb580cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb400039b0 0x7fbb40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb40004d40 0x7fbb400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b2890 con 0x7fbb40004d40 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580cefb0 con 0x7fbb400039b0 2024-02-26T12:19:50.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4000b9c0 con 0x7fbb5815bbf0 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb56d9d640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb400039b0 0x7fbb40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb40004d40 0x7fbb400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5659c640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 -- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 msgr2=0x7fbb40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb5815bbf0 0x7fbb40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 -- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb400039b0 msgr2=0x7fbb40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb400039b0 0x7fbb40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.354+0000 7fbb5759e640 1 -- 172.21.15.113:0/813288128 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40003520 con 0x7fbb40004d40 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5759e640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb40004d40 0x7fbb400051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009ac0 tx=0x7fbb40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d20ff062e0b1f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50039070 con 0x7fbb40004d40 2024-02-26T12:19:50.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5002c710 con 0x7fbb40004d40 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb55d9b640 1 -- 172.21.15.113:0/813288128 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50009690 con 0x7fbb40004d40 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/813288128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb40004d40 msgr2=0x7fbb400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/813288128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb40004d40 0x7fbb400051c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009ac0 tx=0x7fbb40005830 comp rx=0 tx=0).stop 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5759e640 1 -- 172.21.15.113:0/813288128 reap_dead start 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/813288128 shutdown_connections 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/813288128 >> 172.21.15.113:0/813288128 conn(0x7fbb580cc100 msgr2=0x7fbb580cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.355+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/813288128 shutdown_connections 2024-02-26T12:19:50.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.356+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/813288128 wait complete. 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.357+0000 7fbb5d1aa640 1 Processor -- start 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.357+0000 7fbb5d1aa640 1 -- start start 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb58157850 0x7fbb58157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581f4be0 0x7fbb58158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5815bfd0 con 0x7fbb58157470 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580720f0 con 0x7fbb581f4be0 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5815c150 con 0x7fbb58157850 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53046/0 (socket says 172.21.15.113:53046) 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 -- 172.21.15.113:0/2516778337 learned_addr learned my addr 172.21.15.113:0/2516778337 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:50.348 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5759e640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581f4be0 0x7fbb58158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5659c640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb58157850 0x7fbb58157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 -- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb58157850 msgr2=0x7fbb58157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb58157850 0x7fbb58157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 -- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581f4be0 msgr2=0x7fbb58158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581f4be0 0x7fbb58158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 -- 172.21.15.113:0/2516778337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58153980 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb56d9d640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009f90 tx=0x7fbb4800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800fea0 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48015630 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48015a20 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb58153c60 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.358+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58154220 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.359+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58074a50 con 0x7fbb58157470 2024-02-26T12:19:50.349 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.360+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb48015bc0 con 0x7fbb58157470 2024-02-26T12:19:50.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.360+0000 7fbb3f7fe640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.360+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb4808b2a0 con 0x7fbb58157470 2024-02-26T12:19:50.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.360+0000 7fbb5659c640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.361+0000 7fbb5659c640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 0x7fbb4406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb58157c30 tx=0x7fbb4c0078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.350 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.364+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb48019030 con 0x7fbb58157470 2024-02-26T12:19:50.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.537+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb580b5460 con 0x7fbb58157470 2024-02-26T12:19:50.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.537+0000 7fbb3f7fe640 1 -- 172.21.15.113:0/2516778337 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb48010040 con 0x7fbb58157470 2024-02-26T12:19:50.523 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:50.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 msgr2=0x7fbb4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 0x7fbb4406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb58157c30 tx=0x7fbb4c0078f0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 msgr2=0x7fbb58153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009f90 tx=0x7fbb4800f580 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 shutdown_connections 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbb4406b4d0 0x7fbb4406d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb581f4be0 0x7fbb58158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb58157850 0x7fbb58157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 --2- 172.21.15.113:0/2516778337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb58157470 0x7fbb58153080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 >> 172.21.15.113:0/2516778337 conn(0x7fbb580cc100 msgr2=0x7fbb580b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 shutdown_connections 2024-02-26T12:19:50.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.539+0000 7fbb5d1aa640 1 -- 172.21.15.113:0/2516778337 wait complete. 2024-02-26T12:19:50.536 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:50.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.653+0000 7f8541968640 1 Processor -- start 2024-02-26T12:19:50.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.653+0000 7f8541968640 1 -- start start 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f8541968640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f853c15ba50 0x7f853c09ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f8541968640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c099d70 con 0x7f853c15be30 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f8541968640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c09a050 con 0x7f853c0cff40 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f8541968640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c099b20 con 0x7f853c15ba50 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f853affd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f853c15ba50 0x7f853c09ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f853a7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f853c15be30 0x7f853c0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51158/0 (socket says 172.21.15.113:51158) 2024-02-26T12:19:50.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.654+0000 7f853a7fc640 1 -- 172.21.15.113:0/2830318271 learned_addr learned my addr 172.21.15.113:0/2830318271 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:50.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f853affd640 1 -- 172.21.15.113:0/2830318271 >> v1:172.21.15.152:6789/0 conn(0x7f853c0cff40 legacy=0x7f853c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f853affd640 1 -- 172.21.15.113:0/2830318271 >> v1:172.21.15.113:6789/0 conn(0x7f853c15be30 legacy=0x7f853c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f853affd640 1 -- 172.21.15.113:0/2830318271 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c09a330 con 0x7f853c15ba50 2024-02-26T12:19:50.641 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f8539ffb640 1 -- 172.21.15.113:0/2830318271 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973982368 0 0) 0x7f853c099d70 con 0x7f853c15be30 2024-02-26T12:19:50.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f853affd640 1 --2- 172.21.15.113:0/2830318271 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c09ab30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f853c099ca0 tx=0x7f852c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4011d5b3a97ebe server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.655+0000 7f8539ffb640 1 -- 172.21.15.113:0/2830318271 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c039070 con 0x7f853c15ba50 2024-02-26T12:19:50.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8539ffb640 1 -- 172.21.15.113:0/2830318271 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c02cc50 con 0x7f853c15ba50 2024-02-26T12:19:50.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8539ffb640 1 -- 172.21.15.113:0/2830318271 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c034440 con 0x7f853c15ba50 2024-02-26T12:19:50.642 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 -- 172.21.15.113:0/2830318271 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 msgr2=0x7f853c09ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 --2- 172.21.15.113:0/2830318271 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c09ab30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f853c099ca0 tx=0x7f852c02bea0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 -- 172.21.15.113:0/2830318271 shutdown_connections 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 --2- 172.21.15.113:0/2830318271 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c09ab30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 -- 172.21.15.113:0/2830318271 >> 172.21.15.113:0/2830318271 conn(0x7f853c0b3450 msgr2=0x7f853c0b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 -- 172.21.15.113:0/2830318271 shutdown_connections 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.656+0000 7f8541968640 1 -- 172.21.15.113:0/2830318271 wait complete. 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.657+0000 7f8541968640 1 Processor -- start 2024-02-26T12:19:50.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.657+0000 7f8541968640 1 -- start start 2024-02-26T12:19:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 0x7f853c14bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 0x7f853c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0cd690 con 0x7f853c15ba50 2024-02-26T12:19:50.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0cf6f0 con 0x7f853c15be30 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f8541968640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c14c610 con 0x7f853c0cff40 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53060/0 (socket says 172.21.15.113:53060) 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 -- 172.21.15.113:0/1373435182 learned_addr learned my addr 172.21.15.113:0/1373435182 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853affd640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 0x7f853c14bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853b7fe640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 0x7f853c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 -- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 msgr2=0x7f853c14bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 0x7f853c14bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 -- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 msgr2=0x7f853c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 0x7f853c0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853a7fc640 1 -- 172.21.15.113:0/1373435182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c14c8f0 con 0x7f853c15ba50 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853b7fe640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 0x7f853c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.658+0000 7f853affd640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 0x7f853c14bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:50.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f853a7fc640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f853000c3c0 tx=0x7f853000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300074e0 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300047e0 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c14cbd0 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530004bd0 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.659+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c14d190 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.660+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c067650 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.660+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8530011070 con 0x7f853c15ba50 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.660+0000 7f8523fff640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 0x7f852806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.661+0000 7f853affd640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 0x7f852806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.661+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8530089e50 con 0x7f853c15ba50 2024-02-26T12:19:50.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.661+0000 7f853affd640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 0x7f852806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f852c036000 tx=0x7f852c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.665+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f853c067650 con 0x7f853c15ba50 2024-02-26T12:19:50.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.834+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f853c074a50 con 0x7f853c15ba50 2024-02-26T12:19:50.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.834+0000 7f8523fff640 1 -- 172.21.15.113:0/1373435182 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8530058cd0 con 0x7f853c15ba50 2024-02-26T12:19:50.819 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 msgr2=0x7f852806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 0x7f852806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f852c036000 tx=0x7f852c030000 comp rx=0 tx=0).stop 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 msgr2=0x7f853c14d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f853000c3c0 tx=0x7f853000c880 comp rx=0 tx=0).stop 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 shutdown_connections 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f852806b4d0 0x7f852806d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f853c15be30 0x7f853c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f853c15ba50 0x7f853c14d6b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 --2- 172.21.15.113:0/1373435182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f853c0cff40 0x7f853c14bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 >> 172.21.15.113:0/1373435182 conn(0x7f853c0b3450 msgr2=0x7f853c0b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 shutdown_connections 2024-02-26T12:19:50.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.836+0000 7f8541968640 1 -- 172.21.15.113:0/1373435182 wait complete. 2024-02-26T12:19:50.832 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-26T12:19:50.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.947+0000 7f0a13ab0640 1 Processor -- start 2024-02-26T12:19:50.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.948+0000 7f0a13ab0640 1 -- start start 2024-02-26T12:19:50.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.948+0000 7f0a13ab0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0a0c09a150 0x7f0a0c06cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.948+0000 7f0a13ab0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c0d0340 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.948+0000 7f0a13ab0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c0d0620 con 0x7f0a0c0b2c20 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.948+0000 7f0a13ab0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c06c1c0 con 0x7f0a0c09a150 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1204d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0a0c0cfc10 0x7f0a0c15d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51170/0 (socket says 172.21.15.113:51170) 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1204d640 1 -- 172.21.15.113:0/2049001897 learned_addr learned my addr 172.21.15.113:0/2049001897 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1104b640 1 --2- 172.21.15.113:0/2049001897 >> v2:172.21.15.152:3300/0 conn(0x7f0a0c09a150 0x7f0a0c06cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186813203 0 0) 0x7f0a0c0d0340 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f8003520 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249564767 0 0) 0x7f09f8003520 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 >> v2:172.21.15.152:3300/0 conn(0x7f0a0c09a150 msgr2=0x7f0a0c06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 --2- 172.21.15.113:0/2049001897 >> v2:172.21.15.152:3300/0 conn(0x7f0a0c09a150 0x7f0a0c06cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 >> v1:172.21.15.152:6789/0 conn(0x7f0a0c0b2c20 legacy=0x7f0a0c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0d0900 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f0a04001670 con 0x7f0a0c0cfc10 2024-02-26T12:19:50.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 >> v1:172.21.15.113:6789/0 conn(0x7f0a0c0cfc10 legacy=0x7f0a0c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f80039b0 0x7f09f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f80051c0 0x7f09f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f800c030 con 0x7f09f8004800 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f800c1e0 con 0x7f09f80051c0 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f800c3e0 con 0x7f09f80039b0 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1104b640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1184c640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f80039b0 0x7f09f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.949+0000 7f0a1204d640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f80051c0 0x7f09f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 -- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f80039b0 msgr2=0x7f09f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f09f80039b0 0x7f09f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 -- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f80051c0 msgr2=0x7f09f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f80051c0 0x7f09f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1204d640 1 -- 172.21.15.113:0/2049001897 reap_dead start 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 -- 172.21.15.113:0/2049001897 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8003520 con 0x7f09f8004800 2024-02-26T12:19:50.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1104b640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009ac0 tx=0x7f09f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bdb73c2b9e746b server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc039070 con 0x7f09f8004800 2024-02-26T12:19:50.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc02c6b0 con 0x7f09f8004800 2024-02-26T12:19:50.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.950+0000 7f0a1084a640 1 -- 172.21.15.113:0/2049001897 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc009690 con 0x7f09f8004800 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 -- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 msgr2=0x7f09f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009ac0 tx=0x7f09f8005830 comp rx=0 tx=0).stop 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 -- 172.21.15.113:0/2049001897 shutdown_connections 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/2049001897 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09f8004800 0x7f09f8004c80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 -- 172.21.15.113:0/2049001897 >> 172.21.15.113:0/2049001897 conn(0x7f0a0c0b3390 msgr2=0x7f0a0c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:50.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 -- 172.21.15.113:0/2049001897 shutdown_connections 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.951+0000 7f0a13ab0640 1 -- 172.21.15.113:0/2049001897 wait complete. 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.952+0000 7f0a13ab0640 1 Processor -- start 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.952+0000 7f0a13ab0640 1 -- start start 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 0x7f0a0c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0a0c0b6b80 0x7f0a0c0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0d0060 con 0x7f0a0c15efb0 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0d0f50 con 0x7f09f8004800 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a13ab0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0d13e0 con 0x7f0a0c0b6b80 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53082/0 (socket says 172.21.15.113:53082) 2024-02-26T12:19:50.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 -- 172.21.15.113:0/58599155 learned_addr learned my addr 172.21.15.113:0/58599155 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1184c640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 0x7f0a0c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1204d640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0a0c0b6b80 0x7f0a0c0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 -- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0a0c0b6b80 msgr2=0x7f0a0c0b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0a0c0b6b80 0x7f0a0c0b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 -- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 msgr2=0x7f0a0c154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 0x7f0a0c154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 -- 172.21.15.113:0/58599155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0b17a0 con 0x7f0a0c15efb0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1184c640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 0x7f0a0c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.953+0000 7f0a1104b640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009ac0 tx=0x7f09fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.954+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc039050 con 0x7f0a0c15efb0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.954+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc045070 con 0x7f0a0c15efb0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.954+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0b1a80 con 0x7f0a0c15efb0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.954+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0044e0 con 0x7f0a0c15efb0 2024-02-26T12:19:50.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.954+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0b2040 con 0x7f0a0c15efb0 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.955+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c06ddf0 con 0x7f0a0c15efb0 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.955+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09fc003a50 con 0x7f0a0c15efb0 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.956+0000 7f0a027fc640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 0x7f09f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.956+0000 7f0a1184c640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 0x7f09f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.956+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09fc0abe00 con 0x7f0a0c15efb0 2024-02-26T12:19:50.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.956+0000 7f0a1184c640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 0x7f09f006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000f80 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:50.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:50.960+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09fc04e020 con 0x7f0a0c15efb0 2024-02-26T12:19:51.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.143+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0a0c0b2420 con 0x7f0a0c15efb0 2024-02-26T12:19:51.128 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.143+0000 7f0a027fc640 1 -- 172.21.15.113:0/58599155 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0a0c0b2420 con 0x7f0a0c15efb0 2024-02-26T12:19:51.128 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-02-26T12:19:51.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 msgr2=0x7f09f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 0x7f09f006d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000f80 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 msgr2=0x7f0a0c0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009ac0 tx=0x7f09fc004730 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 shutdown_connections 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f09f006b4d0 0x7f09f006d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0a0c0b6b80 0x7f0a0c0b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0a0c15efb0 0x7f0a0c0b0f00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 --2- 172.21.15.113:0/58599155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f09f8004800 0x7f0a0c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 >> 172.21.15.113:0/58599155 conn(0x7f0a0c0b3390 msgr2=0x7f0a0c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 shutdown_connections 2024-02-26T12:19:51.131 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.145+0000 7f0a13ab0640 1 -- 172.21.15.113:0/58599155 wait complete. 2024-02-26T12:19:51.141 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-02-26T12:19:51.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:51.141 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-02-26T12:19:51.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:19:51.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:51.169 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-02-26T12:19:51.224 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:51.225 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:51.244 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:51.245 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:51.303 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:19:51.303 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:19:51.361 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:51.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.479+0000 7fba25276640 1 Processor -- start 2024-02-26T12:19:51.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.479+0000 7fba25276640 1 -- start start 2024-02-26T12:19:51.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.480+0000 7fba25276640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 0x7fba200cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.480+0000 7fba25276640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba2015dc90 0x7fba2015e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.480+0000 7fba25276640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2015e640 con 0x7fba200cd700 2024-02-26T12:19:51.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.480+0000 7fba25276640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200cf890 con 0x7fba2015dc90 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.480+0000 7fba25276640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200ce340 con 0x7fba200cd320 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1effd640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 0x7fba200cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba2015dc90 0x7fba2015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba17fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fba200cd700 0x7fba200cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:49148/0 (socket says 172.21.15.113:49148) 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba17fff640 1 -- 172.21.15.113:0/3540745124 learned_addr learned my addr 172.21.15.113:0/3540745124 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1f7fe640 1 -- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 msgr2=0x7fba200cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1f7fe640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 0x7fba200cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1f7fe640 1 -- 172.21.15.113:0/3540745124 >> v1:172.21.15.152:6789/0 conn(0x7fba200cd700 legacy=0x7fba200cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1f7fe640 1 -- 172.21.15.113:0/3540745124 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200cc5a0 con 0x7fba2015dc90 2024-02-26T12:19:51.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.481+0000 7fba1effd640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 0x7fba200cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.482+0000 7fba1f7fe640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2015dc90 0x7fba2015e100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba18009d90 tx=0x7fba1802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab5435279dc1e2d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.482+0000 7fba1e7fc640 1 -- 172.21.15.113:0/3540745124 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18039070 con 0x7fba2015dc90 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.482+0000 7fba1e7fc640 1 -- 172.21.15.113:0/3540745124 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1802cb30 con 0x7fba2015dc90 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.482+0000 7fba1e7fc640 1 -- 172.21.15.113:0/3540745124 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18034440 con 0x7fba2015dc90 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 -- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2015dc90 msgr2=0x7fba2015e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2015dc90 0x7fba2015e100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba18009d90 tx=0x7fba1802bd80 comp rx=0 tx=0).stop 2024-02-26T12:19:51.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 -- 172.21.15.113:0/3540745124 shutdown_connections 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2015dc90 0x7fba2015e100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 --2- 172.21.15.113:0/3540745124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba200cd320 0x7fba200cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 -- 172.21.15.113:0/3540745124 >> 172.21.15.113:0/3540745124 conn(0x7fba200d0770 msgr2=0x7fba200d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 -- 172.21.15.113:0/3540745124 shutdown_connections 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.483+0000 7fba25276640 1 -- 172.21.15.113:0/3540745124 wait complete. 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.484+0000 7fba25276640 1 Processor -- start 2024-02-26T12:19:51.470 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.484+0000 7fba25276640 1 -- start start 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba200cd700 0x7fba2015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2015dc90 0x7fba200c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200ceb50 con 0x7fba200cd320 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200ce870 con 0x7fba200cd700 2024-02-26T12:19:51.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200cee30 con 0x7fba2015dc90 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53096/0 (socket says 172.21.15.113:53096) 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 -- 172.21.15.113:0/3644024079 learned_addr learned my addr 172.21.15.113:0/3644024079 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba17fff640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba200cd700 0x7fba2015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1f7fe640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2015dc90 0x7fba200c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 -- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2015dc90 msgr2=0x7fba200c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2015dc90 0x7fba200c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 -- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba200cd700 msgr2=0x7fba2015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba200cd700 0x7fba2015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 -- 172.21.15.113:0/3644024079 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200c7f40 con 0x7fba200cd320 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba1effd640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba1000ec10 tx=0x7fba1000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10017070 con 0x7fba200cd320 2024-02-26T12:19:51.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000cc30 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200c8220 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.485+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10013470 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.486+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba200c87e0 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.486+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba20068180 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.487+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba1001a070 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.487+0000 7fba177fe640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 0x7fba0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.487+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba1008a480 con 0x7fba200cd320 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.487+0000 7fba17fff640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 0x7fba0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.488+0000 7fba17fff640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 0x7fba0006d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba200c9230 tx=0x7fba08007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.476 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.491+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba10058cb0 con 0x7fba200cd320 2024-02-26T12:19:51.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.668+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba200c8c20 con 0x7fba200cd320 2024-02-26T12:19:51.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.669+0000 7fba177fe640 1 -- 172.21.15.113:0/3644024079 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fba1005cd50 con 0x7fba200cd320 2024-02-26T12:19:51.655 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:51.655 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 msgr2=0x7fba0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 0x7fba0006d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba200c9230 tx=0x7fba08007e80 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 msgr2=0x7fba200c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fba1000ec10 tx=0x7fba1000c520 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 shutdown_connections 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba0006b4d0 0x7fba0006d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2015dc90 0x7fba200c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba200cd700 0x7fba2015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 --2- 172.21.15.113:0/3644024079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba200cd320 0x7fba200c7840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 >> 172.21.15.113:0/3644024079 conn(0x7fba200d0770 msgr2=0x7fba2006fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:51.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 shutdown_connections 2024-02-26T12:19:51.658 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.671+0000 7fba25276640 1 -- 172.21.15.113:0/3644024079 wait complete. 2024-02-26T12:19:51.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:51.668 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:51.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.786+0000 7f2ad9fe0640 1 Processor -- start 2024-02-26T12:19:51.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.786+0000 7f2ad9fe0640 1 -- start start 2024-02-26T12:19:51.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad9fe0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2ad415a250 0x7f2ad406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad9fe0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad4163d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad9fe0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40ca7c0 con 0x7f2ad40ca9f0 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad9fe0640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad406e4d0 con 0x7f2ad415a250 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad9fe0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406e720 con 0x7f2ad40722e0 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2ad415a250 0x7f2ad406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2ad415a250 0x7f2ad406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53108/0 (socket says 172.21.15.113:53108) 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 -- 172.21.15.113:0/3007254048 learned_addr learned my addr 172.21.15.113:0/3007254048 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 -- 172.21.15.113:0/3007254048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 msgr2=0x7f2ad4163d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad3fff640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad4163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad4163d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 -- 172.21.15.113:0/3007254048 >> v1:172.21.15.152:6789/0 conn(0x7f2ad40ca9f0 legacy=0x7f2ad4071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.787+0000 7f2ad37fe640 1 -- 172.21.15.113:0/3007254048 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad406ea00 con 0x7f2ad415a250 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.788+0000 7f2ad37fe640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad406df90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400bb10 tx=0x7f2ac402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca1dbbb5a3c3ec9 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.788+0000 7f2ad27fc640 1 -- 172.21.15.113:0/3007254048 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac403b070 con 0x7f2ad415a250 2024-02-26T12:19:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.788+0000 7f2ad27fc640 1 -- 172.21.15.113:0/3007254048 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4036440 con 0x7f2ad415a250 2024-02-26T12:19:51.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.788+0000 7f2ad27fc640 1 -- 172.21.15.113:0/3007254048 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4036810 con 0x7f2ad415a250 2024-02-26T12:19:51.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/3007254048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 msgr2=0x7f2ad406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad406df90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400bb10 tx=0x7f2ac402e0c0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/3007254048 shutdown_connections 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad4163d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/3007254048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad406df90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/3007254048 >> 172.21.15.113:0/3007254048 conn(0x7f2ad40cc100 msgr2=0x7f2ad40cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/3007254048 shutdown_connections 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.789+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/3007254048 wait complete. 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.790+0000 7f2ad9fe0640 1 Processor -- start 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.790+0000 7f2ad9fe0640 1 -- start start 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad41521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 0x7f2ad40b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406f2a0 con 0x7f2ad415a250 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406efc0 con 0x7f2ad40ca9f0 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad9fe0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40ce540 con 0x7f2ad40722e0 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53110/0 (socket says 172.21.15.113:53110) 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 -- 172.21.15.113:0/2916313670 learned_addr learned my addr 172.21.15.113:0/2916313670 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 -- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 msgr2=0x7f2ad41521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad2ffd640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 0x7f2ad40b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad41521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 -- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 msgr2=0x7f2ad40b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 0x7f2ad40b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 -- 172.21.15.113:0/2916313670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad41f08a0 con 0x7f2ad415a250 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad2ffd640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 0x7f2ad40b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.791+0000 7f2ad3fff640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cd50 tx=0x7f2acc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.792+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc003b90 con 0x7f2ad415a250 2024-02-26T12:19:51.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.792+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc003d30 con 0x7f2ad415a250 2024-02-26T12:19:51.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.792+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40b2390 con 0x7f2ad415a250 2024-02-26T12:19:51.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.792+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc004240 con 0x7f2ad415a250 2024-02-26T12:19:51.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.792+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad40b2950 con 0x7f2ad415a250 2024-02-26T12:19:51.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.793+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40686b0 con 0x7f2ad415a250 2024-02-26T12:19:51.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.793+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2acc0043e0 con 0x7f2ad415a250 2024-02-26T12:19:51.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.793+0000 7f2abbfff640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:51.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.793+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2acc08ad70 con 0x7f2ad415a250 2024-02-26T12:19:51.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.793+0000 7f2ad37fe640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:51.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.794+0000 7f2ad37fe640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 0x7f2ac006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4038000 tx=0x7f2ac4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:51.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.798+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ad40686b0 con 0x7f2ad415a250 2024-02-26T12:19:51.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.967+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ad40b2160 con 0x7f2ad415a250 2024-02-26T12:19:51.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.967+0000 7f2abbfff640 1 -- 172.21.15.113:0/2916313670 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2acc059b60 con 0x7f2ad415a250 2024-02-26T12:19:51.953 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:51.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 msgr2=0x7f2ac006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 0x7f2ac006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4038000 tx=0x7f2ac4030000 comp rx=0 tx=0).stop 2024-02-26T12:19:51.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 msgr2=0x7f2ad40b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cd50 tx=0x7f2acc00a660 comp rx=0 tx=0).stop 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 shutdown_connections 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f2ac006b4d0 0x7f2ac006d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2ad415a250 0x7f2ad40b0690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ad40ca9f0 0x7f2ad40b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 --2- 172.21.15.113:0/2916313670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2ad40722e0 0x7f2ad41521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 >> 172.21.15.113:0/2916313670 conn(0x7f2ad40cc100 msgr2=0x7f2ad4071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 shutdown_connections 2024-02-26T12:19:51.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:51.969+0000 7f2ad9fe0640 1 -- 172.21.15.113:0/2916313670 wait complete. 2024-02-26T12:19:51.965 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.083+0000 7fd79391e640 1 Processor -- start 2024-02-26T12:19:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 -- start start 2024-02-26T12:19:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd78c15f270 0x7fd78c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd78c0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0d0520 con 0x7fd78c0cd650 2024-02-26T12:19:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c15f650 con 0x7fd78c15f270 2024-02-26T12:19:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.084+0000 7fd79391e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c09b1d0 con 0x7fd78c0b0740 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd791ebb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd78c0cd650 0x7fd78c0ae590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51184/0 (socket says 172.21.15.113:51184) 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd791ebb640 1 -- 172.21.15.113:0/3562168934 learned_addr learned my addr 172.21.15.113:0/3562168934 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd7916ba640 1 --2- 172.21.15.113:0/3562168934 >> v2:172.21.15.152:3300/0 conn(0x7fd78c15f270 0x7fd78c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd790eb9640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd78c0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46197932 0 0) 0x7fd78c0d0520 con 0x7fd78c0cd650 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd778003520 con 0x7fd78c0cd650 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2246794871 0 0) 0x7fd778003520 con 0x7fd78c0cd650 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 msgr2=0x7fd78c0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd78c0cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 >> v2:172.21.15.152:3300/0 conn(0x7fd78c15f270 msgr2=0x7fd78c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 --2- 172.21.15.113:0/3562168934 >> v2:172.21.15.152:3300/0 conn(0x7fd78c15f270 0x7fd78c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0d0800 con 0x7fd78c0cd650 2024-02-26T12:19:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fd7840019f0 con 0x7fd78c0cd650 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 >> v1:172.21.15.113:6789/0 conn(0x7fd78c0cd650 legacy=0x7fd78c0ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7780039b0 0x7fd778003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd778004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd778004d40 0x7fd7780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c15f650 con 0x7fd7780039b0 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c09b1d0 con 0x7fd778004d40 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800b9c0 con 0x7fd78c0b0740 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd7916ba640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7780039b0 0x7fd778003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd791ebb640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd778004d40 0x7fd7780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.085+0000 7fd790eb9640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd778004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 -- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 msgr2=0x7fd778004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd778004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 -- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd778004d40 msgr2=0x7fd7780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd778004d40 0x7fd7780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 -- 172.21.15.113:0/3562168934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778003520 con 0x7fd7780039b0 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd790eb9640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd78c0b0740 0x7fd778004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd7916ba640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7780039b0 0x7fd778003dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd778005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9c5cff7ccb5a0f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c039070 con 0x7fd7780039b0 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c02c710 con 0x7fd7780039b0 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.086+0000 7fd783fff640 1 -- 172.21.15.113:0/3562168934 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c009690 con 0x7fd7780039b0 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 -- 172.21.15.113:0/3562168934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7780039b0 msgr2=0x7fd778003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 --2- 172.21.15.113:0/3562168934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7780039b0 0x7fd778003dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd778005830 comp rx=0 tx=0).stop 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd791ebb640 1 -- 172.21.15.113:0/3562168934 reap_dead start 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 -- 172.21.15.113:0/3562168934 shutdown_connections 2024-02-26T12:19:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 -- 172.21.15.113:0/3562168934 >> 172.21.15.113:0/3562168934 conn(0x7fd78c0b33d0 msgr2=0x7fd78c0b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 -- 172.21.15.113:0/3562168934 shutdown_connections 2024-02-26T12:19:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.087+0000 7fd79391e640 1 -- 172.21.15.113:0/3562168934 wait complete. 2024-02-26T12:19:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.088+0000 7fd79391e640 1 Processor -- start 2024-02-26T12:19:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.088+0000 7fd79391e640 1 -- start start 2024-02-26T12:19:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd7780039b0 0x7fd78c1f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd78c0b4b90 0x7fd78c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0d01f0 con 0x7fd78c15cda0 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0ccbf0 con 0x7fd78c0b4b90 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd79391e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0cc530 con 0x7fd7780039b0 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53124/0 (socket says 172.21.15.113:53124) 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 -- 172.21.15.113:0/1667627369 learned_addr learned my addr 172.21.15.113:0/1667627369 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd7916ba640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd7780039b0 0x7fd78c1f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd791ebb640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd78c0b4b90 0x7fd78c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 -- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd7780039b0 msgr2=0x7fd78c1f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd7780039b0 0x7fd78c1f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 -- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd78c0b4b90 msgr2=0x7fd78c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd78c0b4b90 0x7fd78c0b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 -- 172.21.15.113:0/1667627369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c1f24e0 con 0x7fd78c15cda0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.089+0000 7fd790eb9640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7880115e0 tx=0x7fd788011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.090+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788004220 con 0x7fd78c15cda0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.090+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7880043c0 con 0x7fd78c15cda0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.090+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c1f27c0 con 0x7fd78c15cda0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.090+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78800f910 con 0x7fd78c15cda0 2024-02-26T12:19:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.090+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c1f21d0 con 0x7fd78c15cda0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.091+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c0b4460 con 0x7fd78c15cda0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.091+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd78800fab0 con 0x7fd78c15cda0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.092+0000 7fd781ffb640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.092+0000 7fd7916ba640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.092+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd78808a5d0 con 0x7fd78c15cda0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.092+0000 7fd7916ba640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 0x7fd77006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.096+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd788019030 con 0x7fd78c15cda0 2024-02-26T12:19:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.268+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd78c0b4030 con 0x7fd78c15cda0 2024-02-26T12:19:52.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.268+0000 7fd781ffb640 1 -- 172.21.15.113:0/1667627369 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7880593c0 con 0x7fd78c15cda0 2024-02-26T12:19:52.253 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 msgr2=0x7fd77006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 0x7fd77006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 msgr2=0x7fd78c155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd7880115e0 tx=0x7fd788011aa0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 shutdown_connections 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd77006b4d0 0x7fd77006d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd78c0b4b90 0x7fd78c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd78c15cda0 0x7fd78c155e50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 --2- 172.21.15.113:0/1667627369 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd7780039b0 0x7fd78c1f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 >> 172.21.15.113:0/1667627369 conn(0x7fd78c0b33d0 msgr2=0x7fd78c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 shutdown_connections 2024-02-26T12:19:52.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.270+0000 7fd79391e640 1 -- 172.21.15.113:0/1667627369 wait complete. 2024-02-26T12:19:52.266 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:52.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.383+0000 7f003dc1c640 1 Processor -- start 2024-02-26T12:19:52.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 -- start start 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f003815af30 0x7f003806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f00380cb3b0 0x7f00380cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003815b430 con 0x7f0038154eb0 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00380ce360 con 0x7f003815af30 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.384+0000 7f003dc1c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003815b710 con 0x7f00380cb3b0 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f00377fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0038154eb0 0x7f0038071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51188/0 (socket says 172.21.15.113:51188) 2024-02-26T12:19:52.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f00377fe640 1 -- 172.21.15.113:0/2744772982 learned_addr learned my addr 172.21.15.113:0/2744772982 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0036ffd640 1 --2- 172.21.15.113:0/2744772982 >> v2:172.21.15.113:3300/0 conn(0x7f003815af30 0x7f003806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0037fff640 1 --2- 172.21.15.113:0/2744772982 >> v2:172.21.15.152:3300/0 conn(0x7f00380cb3b0 0x7f00380cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f00367fc640 1 -- 172.21.15.113:0/2744772982 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486196215 0 0) 0x7f003815b430 con 0x7f0038154eb0 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f00367fc640 1 -- 172.21.15.113:0/2744772982 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0020003520 con 0x7f0038154eb0 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0036ffd640 1 -- 172.21.15.113:0/2744772982 >> v2:172.21.15.152:3300/0 conn(0x7f00380cb3b0 msgr2=0x7f00380cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0036ffd640 1 --2- 172.21.15.113:0/2744772982 >> v2:172.21.15.152:3300/0 conn(0x7f00380cb3b0 0x7f00380cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0036ffd640 1 -- 172.21.15.113:0/2744772982 >> v1:172.21.15.113:6789/0 conn(0x7f0038154eb0 legacy=0x7f0038071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.385+0000 7f0036ffd640 1 -- 172.21.15.113:0/2744772982 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003815b9f0 con 0x7f003815af30 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f0036ffd640 1 --2- 172.21.15.113:0/2744772982 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f003815af30 0x7f003806f2b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00380c9c80 tx=0x7f002c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f0b1182c33c84d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f00367fc640 1 -- 172.21.15.113:0/2744772982 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0315a0 con 0x7f003815af30 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f00367fc640 1 -- 172.21.15.113:0/2744772982 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c037070 con 0x7f003815af30 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f00367fc640 1 -- 172.21.15.113:0/2744772982 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c031960 con 0x7f003815af30 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 -- 172.21.15.113:0/2744772982 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f003815af30 msgr2=0x7f003806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 --2- 172.21.15.113:0/2744772982 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f003815af30 0x7f003806f2b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00380c9c80 tx=0x7f002c02b840 comp rx=0 tx=0).stop 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 -- 172.21.15.113:0/2744772982 shutdown_connections 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 --2- 172.21.15.113:0/2744772982 >> v2:172.21.15.152:3300/0 conn(0x7f00380cb3b0 0x7f00380cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 --2- 172.21.15.113:0/2744772982 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f003815af30 0x7f003806f2b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 -- 172.21.15.113:0/2744772982 >> 172.21.15.113:0/2744772982 conn(0x7f00380cc100 msgr2=0x7f00380cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 -- 172.21.15.113:0/2744772982 shutdown_connections 2024-02-26T12:19:52.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.386+0000 7f003dc1c640 1 -- 172.21.15.113:0/2744772982 wait complete. 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 Processor -- start 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 -- start start 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f00380cb3b0 0x7f00380b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003815af30 0x7f0038151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380ccf60 con 0x7f0038154eb0 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380ccde0 con 0x7f003815af30 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.388+0000 7f003dc1c640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0038155290 con 0x7f00380cb3b0 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53142/0 (socket says 172.21.15.113:53142) 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 -- 172.21.15.113:0/1322912852 learned_addr learned my addr 172.21.15.113:0/1322912852 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0037fff640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003815af30 0x7f0038151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 -- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f00380cb3b0 msgr2=0x7f00380b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f00380cb3b0 0x7f00380b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 -- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003815af30 msgr2=0x7f0038151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003815af30 0x7f0038151e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 -- 172.21.15.113:0/1322912852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00381f1950 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f0036ffd640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f002c000c00 tx=0x7f002c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c032630 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c0327f0 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c032be0 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00381f1c30 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.389+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00381f24d0 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.390+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00381f2020 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.390+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f002c04d3f0 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.391+0000 7f001ffff640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 0x7f002406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.391+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f002c02f030 con 0x7f0038154eb0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.391+0000 7f00377fe640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 0x7f002406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.391+0000 7f00377fe640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 0x7f002406d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0028000f60 tx=0x7f00280078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.395+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f002c040070 con 0x7f0038154eb0 2024-02-26T12:19:52.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.565+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00381f1e00 con 0x7f0038154eb0 2024-02-26T12:19:52.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.566+0000 7f001ffff640 1 -- 172.21.15.113:0/1322912852 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f002c07a570 con 0x7f0038154eb0 2024-02-26T12:19:52.552 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:52.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 msgr2=0x7f002406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 0x7f002406d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0028000f60 tx=0x7f00280078f0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 msgr2=0x7f00380c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f002c000c00 tx=0x7f002c0046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 shutdown_connections 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f002406b4d0 0x7f002406d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f003815af30 0x7f0038151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0038154eb0 0x7f00380c9f30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 --2- 172.21.15.113:0/1322912852 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f00380cb3b0 0x7f00380b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 >> 172.21.15.113:0/1322912852 conn(0x7f00380cc100 msgr2=0x7f00380ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 shutdown_connections 2024-02-26T12:19:52.554 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.568+0000 7f003dc1c640 1 -- 172.21.15.113:0/1322912852 wait complete. 2024-02-26T12:19:52.564 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.680+0000 7f99711fe640 1 Processor -- start 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.680+0000 7f99711fe640 1 -- start start 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f99711fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f996c099a40 0x7f996c099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f99711fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f996c0b18f0 0x7f996c0b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f99711fe640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c0b0e50 con 0x7f996c15bd70 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f99711fe640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c15c150 con 0x7f996c0b18f0 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f99711fe640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996c09ac10 con 0x7f996c099a40 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f996c0b18f0 0x7f996c0b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f996c0b18f0 0x7f996c0b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53156/0 (socket says 172.21.15.113:53156) 2024-02-26T12:19:52.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 -- 172.21.15.113:0/707786077 learned_addr learned my addr 172.21.15.113:0/707786077 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:52.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 -- 172.21.15.113:0/707786077 >> v2:172.21.15.152:3300/0 conn(0x7f996c099a40 msgr2=0x7f996c099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 --2- 172.21.15.113:0/707786077 >> v2:172.21.15.152:3300/0 conn(0x7f996c099a40 0x7f996c099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 -- 172.21.15.113:0/707786077 >> v1:172.21.15.152:6789/0 conn(0x7f996c15bd70 legacy=0x7f996c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:52.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.681+0000 7f996b59e640 1 -- 172.21.15.113:0/707786077 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c0b10f0 con 0x7f996c0b18f0 2024-02-26T12:19:52.669 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.682+0000 7f996b59e640 1 --2- 172.21.15.113:0/707786077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c0b18f0 0x7f996c0b1d40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f996c072be0 tx=0x7f996402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56fc6b945047e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.682+0000 7f9969d9b640 1 -- 172.21.15.113:0/707786077 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964035020 con 0x7f996c0b18f0 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.682+0000 7f9969d9b640 1 -- 172.21.15.113:0/707786077 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964031870 con 0x7f996c0b18f0 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.682+0000 7f9969d9b640 1 -- 172.21.15.113:0/707786077 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964031c40 con 0x7f996c0b18f0 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 -- 172.21.15.113:0/707786077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c0b18f0 msgr2=0x7f996c0b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 --2- 172.21.15.113:0/707786077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c0b18f0 0x7f996c0b1d40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f996c072be0 tx=0x7f996402b910 comp rx=0 tx=0).stop 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 -- 172.21.15.113:0/707786077 shutdown_connections 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 --2- 172.21.15.113:0/707786077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c0b18f0 0x7f996c0b1d40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 --2- 172.21.15.113:0/707786077 >> v2:172.21.15.152:3300/0 conn(0x7f996c099a40 0x7f996c099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 -- 172.21.15.113:0/707786077 >> 172.21.15.113:0/707786077 conn(0x7f996c0b3390 msgr2=0x7f996c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 -- 172.21.15.113:0/707786077 shutdown_connections 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.683+0000 7f99711fe640 1 -- 172.21.15.113:0/707786077 wait complete. 2024-02-26T12:19:52.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.684+0000 7f99711fe640 1 Processor -- start 2024-02-26T12:19:52.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.684+0000 7f99711fe640 1 -- start start 2024-02-26T12:19:52.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f996c0b18f0 0x7f996c0c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996c15bd70 0x7f996c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c09a8c0 con 0x7f996c099a40 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c09aef0 con 0x7f996c0b18f0 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f99711fe640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0cd820 con 0x7f996c15bd70 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53162/0 (socket says 172.21.15.113:53162) 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 -- 172.21.15.113:0/2053629373 learned_addr learned my addr 172.21.15.113:0/2053629373 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996a59c640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f996c0b18f0 0x7f996c0c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996b59e640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996c15bd70 0x7f996c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 -- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996c15bd70 msgr2=0x7f996c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996c15bd70 0x7f996c0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 -- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f996c0b18f0 msgr2=0x7f996c0c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f996c0b18f0 0x7f996c0c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.685+0000 7f996ad9d640 1 -- 172.21.15.113:0/2053629373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c15d3f0 con 0x7f996c099a40 2024-02-26T12:19:52.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f996ad9d640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c7d0 tx=0x7f995c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c017070 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c003da0 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c15d6d0 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0052b0 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.686+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c0c8180 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.687+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c074a50 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.687+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f995c01a070 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.688+0000 7f99537fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 0x7f995806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.688+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f995c089880 con 0x7f996c099a40 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.688+0000 7f996a59c640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 0x7f995806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:52.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.688+0000 7f996a59c640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 0x7f995806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f996c15e600 tx=0x7f9960008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:52.677 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.692+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f995c058790 con 0x7f996c099a40 2024-02-26T12:19:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.874+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f996c09a250 con 0x7f996c099a40 2024-02-26T12:19:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.875+0000 7f99537fe640 1 -- 172.21.15.113:0/2053629373 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f995c058090 con 0x7f996c099a40 2024-02-26T12:19:52.860 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-02-26T12:19:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 msgr2=0x7f995806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 0x7f995806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f996c15e600 tx=0x7f9960008040 comp rx=0 tx=0).stop 2024-02-26T12:19:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 msgr2=0x7f996c0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:52.862 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c7d0 tx=0x7f995c00cc90 comp rx=0 tx=0).stop 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 shutdown_connections 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f995806b4d0 0x7f995806d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f996c15bd70 0x7f996c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f996c0b18f0 0x7f996c0c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 --2- 172.21.15.113:0/2053629373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f996c099a40 0x7f996c0c8970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 >> 172.21.15.113:0/2053629373 conn(0x7f996c0b3390 msgr2=0x7f996c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 shutdown_connections 2024-02-26T12:19:52.863 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:52.877+0000 7f99711fe640 1 -- 172.21.15.113:0/2053629373 wait complete. 2024-02-26T12:19:52.873 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-02-26T12:19:52.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:52.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-02-26T12:19:52.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:19:52.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:19:52.907 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-02-26T12:19:52.966 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-02-26T12:19:52.966 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:53.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.081+0000 7f72e902d640 1 Processor -- start 2024-02-26T12:19:53.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.081+0000 7f72e902d640 1 -- start start 2024-02-26T12:19:53.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e902d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f72e406eb70 0x7f72e40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e902d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40cf670 con 0x7f72e40711f0 2024-02-26T12:19:53.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e902d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40cf950 con 0x7f72e4071ce0 2024-02-26T12:19:53.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e902d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e4145840 con 0x7f72e406eb70 2024-02-26T12:19:53.070 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e2d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f72e40711f0 0x7f72e40715d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51190/0 (socket says 172.21.15.113:51190) 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e2d9d640 1 -- 172.21.15.113:0/984069175 learned_addr learned my addr 172.21.15.113:0/984069175 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72dbfff640 1 --2- 172.21.15.113:0/984069175 >> v2:172.21.15.152:3300/0 conn(0x7f72e406eb70 0x7f72e40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077534800 0 0) 0x7f72e40cf670 con 0x7f72e40711f0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d0003520 con 0x7f72e40711f0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145133060 0 0) 0x7f72d0003520 con 0x7f72e40711f0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 >> v2:172.21.15.152:3300/0 conn(0x7f72e406eb70 msgr2=0x7f72e40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 --2- 172.21.15.113:0/984069175 >> v2:172.21.15.152:3300/0 conn(0x7f72e406eb70 0x7f72e40ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.082+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 >> v1:172.21.15.152:6789/0 conn(0x7f72e4071ce0 legacy=0x7f72e40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40cfc30 con 0x7f72e40711f0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f72d4001670 con 0x7f72e40711f0 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 >> v1:172.21.15.113:6789/0 conn(0x7f72e40711f0 legacy=0x7f72e40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 0x7f72d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72d00043b0 0x7f72d0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d0005080 0x7f72d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4145840 con 0x7f72d00039b0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d000bfe0 con 0x7f72d0005080 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d000c1e0 con 0x7f72d00043b0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 0x7f72d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e359e640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d0005080 0x7f72d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72dbfff640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72d00043b0 0x7f72d0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 -- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72d00043b0 msgr2=0x7f72d0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72d00043b0 0x7f72d0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 -- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d0005080 msgr2=0x7f72d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d0005080 0x7f72d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e2d9d640 1 -- 172.21.15.113:0/984069175 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0003520 con 0x7f72d00039b0 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e359e640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d0005080 0x7f72d000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:53.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.083+0000 7f72e359e640 1 -- 172.21.15.113:0/984069175 reap_dead start 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 0x7f72d0003d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c240 tx=0x7f72d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd790d9f76fa0245 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4007d10 con 0x7f72d00039b0 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d4030070 con 0x7f72d00039b0 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e259c640 1 -- 172.21.15.113:0/984069175 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d402cda0 con 0x7f72d00039b0 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 -- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 msgr2=0x7f72d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 0x7f72d0003d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c240 tx=0x7f72d0005830 comp rx=0 tx=0).stop 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 -- 172.21.15.113:0/984069175 shutdown_connections 2024-02-26T12:19:53.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 --2- 172.21.15.113:0/984069175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72d00039b0 0x7f72d0003d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 -- 172.21.15.113:0/984069175 >> 172.21.15.113:0/984069175 conn(0x7f72e406ab50 msgr2=0x7f72e406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 -- 172.21.15.113:0/984069175 shutdown_connections 2024-02-26T12:19:53.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.084+0000 7f72e902d640 1 -- 172.21.15.113:0/984069175 wait complete. 2024-02-26T12:19:53.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 Processor -- start 2024-02-26T12:19:53.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 -- start start 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 0x7f72e413e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 0x7f72e40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4071750 con 0x7f72e41428f0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40715d0 con 0x7f72d00039b0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.086+0000 7f72e902d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40718d0 con 0x7f72e40b31d0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53190/0 (socket says 172.21.15.113:53190) 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 -- 172.21.15.113:0/2553187952 learned_addr learned my addr 172.21.15.113:0/2553187952 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72dbfff640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 0x7f72e40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 0x7f72e413e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 -- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 msgr2=0x7f72e40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 0x7f72e40b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 -- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 msgr2=0x7f72e413e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 0x7f72e413e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 -- 172.21.15.113:0/2553187952 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e41436c0 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72dbfff640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 0x7f72e40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 0x7f72e413e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e359e640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72e4072420 tx=0x7f72dc00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc003970 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc018070 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e41439a0 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc003d50 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.087+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e4143f60 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.088+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4074a50 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.089+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72dc0050d0 con 0x7f72e41428f0 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.089+0000 7f72db7fe640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 0x7f72c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.089+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72dc089e70 con 0x7f72e41428f0 2024-02-26T12:19:53.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.089+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 0x7f72c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.089+0000 7f72e2d9d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 0x7f72c406d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f72d4034000 tx=0x7f72d4007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.093+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72dc058cf0 con 0x7f72e41428f0 2024-02-26T12:19:53.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.298+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72e40b0090 con 0x7f72e41428f0 2024-02-26T12:19:53.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.298+0000 7f72db7fe640 1 -- 172.21.15.113:0/2553187952 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f72dc0585f0 con 0x7f72e41428f0 2024-02-26T12:19:53.284 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:53.284 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:53.284 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 msgr2=0x7f72c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 0x7f72c406d9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f72d4034000 tx=0x7f72d4007000 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 msgr2=0x7f72e4142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72e4072420 tx=0x7f72dc00eb70 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 shutdown_connections 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f72c406b500 0x7f72c406d9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72e41428f0 0x7f72e4142d70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72e40b31d0 0x7f72e40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 --2- 172.21.15.113:0/2553187952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72d00039b0 0x7f72e413e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 >> 172.21.15.113:0/2553187952 conn(0x7f72e406ab50 msgr2=0x7f72e40af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 shutdown_connections 2024-02-26T12:19:53.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.300+0000 7f72e902d640 1 -- 172.21.15.113:0/2553187952 wait complete. 2024-02-26T12:19:53.296 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:53.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.412+0000 7f172b2c8640 1 Processor -- start 2024-02-26T12:19:53.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.412+0000 7f172b2c8640 1 -- start start 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f172415ddf0 0x7f1724070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17240cf930 0x7f17240ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17240caa80 0x7f17240cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240caed0 con 0x7f172415ddf0 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172406b700 con 0x7f17240caa80 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f172b2c8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172406b9e0 con 0x7f17240cf930 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f172415ddf0 0x7f1724070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f172415ddf0 0x7f1724070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53192/0 (socket says 172.21.15.113:53192) 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 -- 172.21.15.113:0/1503153864 learned_addr learned my addr 172.21.15.113:0/1503153864 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729865640 1 --2- 172.21.15.113:0/1503153864 >> v2:172.21.15.152:3300/0 conn(0x7f17240caa80 0x7f17240cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1728863640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17240cf930 0x7f17240ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 -- 172.21.15.113:0/1503153864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17240cf930 msgr2=0x7f17240ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17240cf930 0x7f17240ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 -- 172.21.15.113:0/1503153864 >> v2:172.21.15.152:3300/0 conn(0x7f17240caa80 msgr2=0x7f17240cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 --2- 172.21.15.113:0/1503153864 >> v2:172.21.15.152:3300/0 conn(0x7f17240caa80 0x7f17240cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.413+0000 7f1729064640 1 -- 172.21.15.113:0/1503153864 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172406bcc0 con 0x7f172415ddf0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f1729064640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f172415ddf0 0x7f1724070010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f17240cd940 tx=0x7f172002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb4395663734c75 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f171bfff640 1 -- 172.21.15.113:0/1503153864 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172002e070 con 0x7f172415ddf0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f171bfff640 1 -- 172.21.15.113:0/1503153864 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720037070 con 0x7f172415ddf0 2024-02-26T12:19:53.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f171bfff640 1 -- 172.21.15.113:0/1503153864 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720031a00 con 0x7f172415ddf0 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 -- 172.21.15.113:0/1503153864 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f172415ddf0 msgr2=0x7f1724070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f172415ddf0 0x7f1724070010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f17240cd940 tx=0x7f172002b880 comp rx=0 tx=0).stop 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 -- 172.21.15.113:0/1503153864 shutdown_connections 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 --2- 172.21.15.113:0/1503153864 >> v2:172.21.15.152:3300/0 conn(0x7f17240caa80 0x7f17240cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17240cf930 0x7f17240ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 --2- 172.21.15.113:0/1503153864 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f172415ddf0 0x7f1724070010 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.414+0000 7f172b2c8640 1 -- 172.21.15.113:0/1503153864 >> 172.21.15.113:0/1503153864 conn(0x7f17240cc970 msgr2=0x7f17240ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.415+0000 7f172b2c8640 1 -- 172.21.15.113:0/1503153864 shutdown_connections 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.415+0000 7f172b2c8640 1 -- 172.21.15.113:0/1503153864 wait complete. 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 Processor -- start 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 -- start start 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17240cf930 0x7f17240c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f172415ddf0 0x7f17240c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240ce260 con 0x7f17240caa80 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240ce0e0 con 0x7f17240cf930 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f172b2c8640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240ce3e0 con 0x7f172415ddf0 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f1729064640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f1729064640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53200/0 (socket says 172.21.15.113:53200) 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.416+0000 7f1729064640 1 -- 172.21.15.113:0/821088931 learned_addr learned my addr 172.21.15.113:0/821088931 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:53.404 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 -- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f172415ddf0 msgr2=0x7f17240c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f172415ddf0 0x7f17240c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1728863640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17240cf930 0x7f17240c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 -- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17240cf930 msgr2=0x7f17240c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17240cf930 0x7f17240c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 -- 172.21.15.113:0/821088931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240c8580 con 0x7f17240caa80 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1729064640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f17200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720032670 con 0x7f17240caa80 2024-02-26T12:19:53.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720032810 con 0x7f17240caa80 2024-02-26T12:19:53.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17240c8860 con 0x7f17240caa80 2024-02-26T12:19:53.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720032c00 con 0x7f17240caa80 2024-02-26T12:19:53.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.417+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17240c8e20 con 0x7f17240caa80 2024-02-26T12:19:53.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.418+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1724074a50 con 0x7f17240caa80 2024-02-26T12:19:53.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.419+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f172004c060 con 0x7f17240caa80 2024-02-26T12:19:53.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.419+0000 7f1719ffb640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 0x7f170806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.419+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17200abaa0 con 0x7f17240caa80 2024-02-26T12:19:53.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.419+0000 7f1728863640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 0x7f170806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.419+0000 7f1728863640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 0x7f170806d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f172414db00 tx=0x7f1714008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.408 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.423+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1720040070 con 0x7f17240caa80 2024-02-26T12:19:53.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.597+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1724070340 con 0x7f17240caa80 2024-02-26T12:19:53.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.598+0000 7f1719ffb640 1 -- 172.21.15.113:0/821088931 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f172007a9e0 con 0x7f17240caa80 2024-02-26T12:19:53.584 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:53.584 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 msgr2=0x7f170806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 0x7f170806d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f172414db00 tx=0x7f1714008040 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 msgr2=0x7f1724159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f17200046c0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 shutdown_connections 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f170806b4d0 0x7f170806d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f172415ddf0 0x7f17240c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17240cf930 0x7f17240c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 --2- 172.21.15.113:0/821088931 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17240caa80 0x7f1724159a70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 >> 172.21.15.113:0/821088931 conn(0x7f17240cc970 msgr2=0x7f172406eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 shutdown_connections 2024-02-26T12:19:53.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.600+0000 7f172b2c8640 1 -- 172.21.15.113:0/821088931 wait complete. 2024-02-26T12:19:53.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:19:17.081697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:19:17.763671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:19:53.597 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:19:53.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.714+0000 7f4103884640 1 Processor -- start 2024-02-26T12:19:53.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.714+0000 7f4103884640 1 -- start start 2024-02-26T12:19:53.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4103884640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40fc0d3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4103884640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f40fc0cf290 0x7f40fc0d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4103884640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc06c640 con 0x7f40fc0ce610 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4103884640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc0d2cc0 con 0x7f40fc0cf290 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4103884640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06c920 con 0x7f40fc15e0d0 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4100e1f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f40fc0ce610 0x7f40fc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51196/0 (socket says 172.21.15.113:51196) 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.715+0000 7f4100e1f640 1 -- 172.21.15.113:0/2137000860 learned_addr learned my addr 172.21.15.113:0/2137000860 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 --2- 172.21.15.113:0/2137000860 >> v2:172.21.15.152:3300/0 conn(0x7f40fc0cf290 0x7f40fc0d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101620640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40fc0d3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143996964 0 0) 0x7f40fc06c640 con 0x7f40fc0ce610 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40e8003520 con 0x7f40fc0ce610 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3739395913 0 0) 0x7f40e8003520 con 0x7f40fc0ce610 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 msgr2=0x7f40fc0d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40fc0d3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 >> v2:172.21.15.152:3300/0 conn(0x7f40fc0cf290 msgr2=0x7f40fc0d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 --2- 172.21.15.113:0/2137000860 >> v2:172.21.15.152:3300/0 conn(0x7f40fc0cf290 0x7f40fc0d16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0d2950 con 0x7f40fc0ce610 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f40ec001670 con 0x7f40fc0ce610 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 >> v1:172.21.15.113:6789/0 conn(0x7f40fc0ce610 legacy=0x7f40fc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e8003f30 0x7f40e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40e8004d40 0x7f40e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0d2cc0 con 0x7f40e8004d40 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06c920 con 0x7f40e8003f30 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e800b9f0 con 0x7f40fc15e0d0 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40e8004d40 0x7f40e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101620640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4100e1f640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e8003f30 0x7f40e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 -- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 msgr2=0x7f40e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc15e0d0 0x7f40e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 -- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e8003f30 msgr2=0x7f40e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40e8003f30 0x7f40e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.716+0000 7f4101e21640 1 -- 172.21.15.113:0/2137000860 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8003520 con 0x7f40e8004d40 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.717+0000 7f4101e21640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40e8004d40 0x7f40e80051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fc0 tx=0x7f40e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ca4f0710f0971 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.717+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4039070 con 0x7f40e8004d40 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.717+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f402cc60 con 0x7f40e8004d40 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.717+0000 7f40f3fff640 1 -- 172.21.15.113:0/2137000860 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4009c10 con 0x7f40e8004d40 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 -- 172.21.15.113:0/2137000860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40e8004d40 msgr2=0x7f40e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 --2- 172.21.15.113:0/2137000860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40e8004d40 0x7f40e80051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fc0 tx=0x7f40e8005830 comp rx=0 tx=0).stop 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4101e21640 1 -- 172.21.15.113:0/2137000860 reap_dead start 2024-02-26T12:19:53.706 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 -- 172.21.15.113:0/2137000860 shutdown_connections 2024-02-26T12:19:53.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 -- 172.21.15.113:0/2137000860 >> 172.21.15.113:0/2137000860 conn(0x7f40fc0d3b20 msgr2=0x7f40fc0d3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 -- 172.21.15.113:0/2137000860 shutdown_connections 2024-02-26T12:19:53.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.718+0000 7f4103884640 1 -- 172.21.15.113:0/2137000860 wait complete. 2024-02-26T12:19:53.709 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.719+0000 7f4103884640 1 Processor -- start 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.719+0000 7f4103884640 1 -- start start 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 0x7f40fc0abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 0x7f40fc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06c080 con 0x7f40fc158070 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0d4950 con 0x7f40fc0b1b80 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc06c200 con 0x7f40fc158450 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53214/0 (socket says 172.21.15.113:53214) 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 -- 172.21.15.113:0/3855398595 learned_addr learned my addr 172.21.15.113:0/3855398595 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4100e1f640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 0x7f40fc0abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.710 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101e21640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 0x7f40fc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 -- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 msgr2=0x7f40fc0abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 0x7f40fc0abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 -- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 msgr2=0x7f40fc0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 0x7f40fc0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 -- 172.21.15.113:0/3855398595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0aac10 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4100e1f640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 0x7f40fc0abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101e21640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 0x7f40fc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4101620640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f80119a0 tx=0x7f40f8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f800faf0 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f800fc90 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0aaef0 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.720+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8014440 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.721+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc0ab4b0 con 0x7f40fc158070 2024-02-26T12:19:53.711 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.721+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc074a50 con 0x7f40fc158070 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.722+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40f8012040 con 0x7f40fc158070 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.722+0000 7f40f1ffb640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.722+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40f808a8f0 con 0x7f40fc158070 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.722+0000 7f4100e1f640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.723+0000 7f4100e1f640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 0x7f40e006d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40ec001eb0 tx=0x7f40ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:53.712 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.726+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40f8019030 con 0x7f40fc158070 2024-02-26T12:19:53.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.896+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40fc0cdfe0 con 0x7f40fc158070 2024-02-26T12:19:53.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.897+0000 7f40f1ffb640 1 -- 172.21.15.113:0/3855398595 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40f8059120 con 0x7f40fc158070 2024-02-26T12:19:53.882 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.898+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 msgr2=0x7f40e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.898+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 0x7f40e006d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40ec001eb0 tx=0x7f40ec009040 comp rx=0 tx=0).stop 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.898+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 msgr2=0x7f40fc0aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.898+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40f80119a0 tx=0x7f40f8011e60 comp rx=0 tx=0).stop 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 shutdown_connections 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f40e006b4d0 0x7f40e006d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.884 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f40fc0b1b80 0x7f40fc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f40fc158450 0x7f40fc0abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 --2- 172.21.15.113:0/3855398595 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f40fc158070 0x7f40fc0aa4a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:53.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 >> 172.21.15.113:0/3855398595 conn(0x7f40fc0d3b20 msgr2=0x7f40fc15c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:53.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 shutdown_connections 2024-02-26T12:19:53.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:53.899+0000 7f4103884640 1 -- 172.21.15.113:0/3855398595 wait complete. 2024-02-26T12:19:53.894 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:19:53.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.013+0000 7fcae9c2d640 1 Processor -- start 2024-02-26T12:19:53.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.013+0000 7fcae9c2d640 1 -- start start 2024-02-26T12:19:54.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae9c2d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcae4161480 0x7fcae40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae9c2d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae406fa10 con 0x7fcae406b000 2024-02-26T12:19:54.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae9c2d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae406b490 con 0x7fcae406ab50 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae9c2d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae406fc80 con 0x7fcae4161480 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae37fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcae4161480 0x7fcae40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae3fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcae406b000 0x7fcae40cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51208/0 (socket says 172.21.15.113:51208) 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae3fff640 1 -- 172.21.15.113:0/3886661337 learned_addr learned my addr 172.21.15.113:0/3886661337 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae37fe640 1 -- 172.21.15.113:0/3886661337 >> v1:172.21.15.152:6789/0 conn(0x7fcae406ab50 legacy=0x7fcae40cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae37fe640 1 -- 172.21.15.113:0/3886661337 >> v1:172.21.15.113:6789/0 conn(0x7fcae406b000 legacy=0x7fcae40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae27fc640 1 -- 172.21.15.113:0/3886661337 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796850486 0 0) 0x7fcae406fa10 con 0x7fcae406b000 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.014+0000 7fcae37fe640 1 -- 172.21.15.113:0/3886661337 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae406ff60 con 0x7fcae4161480 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.015+0000 7fcae37fe640 1 --2- 172.21.15.113:0/3886661337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae4161480 0x7fcae40cae50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097a0 tx=0x7fcad402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a3f68bbe913c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.015+0000 7fcae27fc640 1 -- 172.21.15.113:0/3886661337 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4035020 con 0x7fcae4161480 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.015+0000 7fcae27fc640 1 -- 172.21.15.113:0/3886661337 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4031830 con 0x7fcae4161480 2024-02-26T12:19:54.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.015+0000 7fcae27fc640 1 -- 172.21.15.113:0/3886661337 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4031c00 con 0x7fcae4161480 2024-02-26T12:19:54.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3886661337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae4161480 msgr2=0x7fcae40cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3886661337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae4161480 0x7fcae40cae50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcad40097a0 tx=0x7fcad402b8d0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3886661337 shutdown_connections 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3886661337 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae4161480 0x7fcae40cae50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3886661337 >> 172.21.15.113:0/3886661337 conn(0x7fcae4099a40 msgr2=0x7fcae40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3886661337 shutdown_connections 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.016+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3886661337 wait complete. 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.017+0000 7fcae9c2d640 1 Processor -- start 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.017+0000 7fcae9c2d640 1 -- start start 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae406ab50 0x7fcae41f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae4161480 0x7fcae40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40d02b0 con 0x7fcae406b000 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40d0130 con 0x7fcae4161480 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae9c2d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40d0430 con 0x7fcae406ab50 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53238/0 (socket says 172.21.15.113:53238) 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 -- 172.21.15.113:0/3027390230 learned_addr learned my addr 172.21.15.113:0/3027390230 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae3fff640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae4161480 0x7fcae40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae37fe640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae406ab50 0x7fcae41f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 -- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae406ab50 msgr2=0x7fcae41f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae406ab50 0x7fcae41f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 -- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae4161480 msgr2=0x7fcae40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae4161480 0x7fcae40ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 -- 172.21.15.113:0/3027390230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40ca7c0 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.018+0000 7fcae2ffd640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcad800b3f0 tx=0x7fcad800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.019+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8015020 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.019+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8011830 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.019+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae41f7260 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.019+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011c20 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.019+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae41f7820 con 0x7fcae406b000 2024-02-26T12:19:54.007 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.020+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae41f7a20 con 0x7fcae406b000 2024-02-26T12:19:54.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.020+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcad8018020 con 0x7fcae406b000 2024-02-26T12:19:54.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.020+0000 7fcacbfff640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.021+0000 7fcae37fe640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.021+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcad8089e20 con 0x7fcae406b000 2024-02-26T12:19:54.009 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.021+0000 7fcae37fe640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcad4036000 tx=0x7fcad403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.010 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.025+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcae41f7a20 con 0x7fcae406b000 2024-02-26T12:19:54.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.195+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcae4074a50 con 0x7fcae406b000 2024-02-26T12:19:54.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.195+0000 7fcacbfff640 1 -- 172.21.15.113:0/3027390230 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcad801f030 con 0x7fcae406b000 2024-02-26T12:19:54.181 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.197+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 msgr2=0x7fcad006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.197+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 0x7fcad006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcad4036000 tx=0x7fcad403c040 comp rx=0 tx=0).stop 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.197+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 msgr2=0x7fcae40b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.197+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcad800b3f0 tx=0x7fcad800b8b0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 shutdown_connections 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcad006b4d0 0x7fcad006d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcae4161480 0x7fcae40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcae406b000 0x7fcae40b42a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 --2- 172.21.15.113:0/3027390230 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcae406ab50 0x7fcae41f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 >> 172.21.15.113:0/3027390230 conn(0x7fcae4099a40 msgr2=0x7fcae406e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 shutdown_connections 2024-02-26T12:19:54.184 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.198+0000 7fcae9c2d640 1 -- 172.21.15.113:0/3027390230 wait complete. 2024-02-26T12:19:54.194 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:19:54.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.311+0000 7fd0b6ed1640 1 Processor -- start 2024-02-26T12:19:54.297 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.311+0000 7fd0b6ed1640 1 -- start start 2024-02-26T12:19:54.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0b6ed1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd0b00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.300 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0b6ed1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00d1dc0 con 0x7fd0b00b5b50 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0b6ed1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b00cf000 con 0x7fd0b00ceb00 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0b6ed1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00b5fb0 con 0x7fd0b015de30 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0affff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd0b00b5b50 0x7fd0b00ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51218/0 (socket says 172.21.15.113:51218) 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.312+0000 7fd0affff640 1 -- 172.21.15.113:0/1608017662 learned_addr learned my addr 172.21.15.113:0/1608017662 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd0b00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949713230 0 0) 0x7fd0b00d1dc0 con 0x7fd0b00b5b50 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd098003520 con 0x7fd0b00b5b50 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757306143 0 0) 0x7fd098003520 con 0x7fd0b00b5b50 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 msgr2=0x7fd0b00b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd0b00b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 >> v1:172.21.15.152:6789/0 conn(0x7fd0b00ceb00 legacy=0x7fd0b00d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.301 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00d2060 con 0x7fd0b00b5b50 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fd0a4001670 con 0x7fd0b00b5b50 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 >> v1:172.21.15.113:6789/0 conn(0x7fd0b00b5b50 legacy=0x7fd0b00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0980039e0 0x7fd098003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd098004d40 0x7fd0980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09800ba70 con 0x7fd0980039e0 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09800bbf0 con 0x7fd098004d40 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09800bdf0 con 0x7fd0b015de30 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0980039e0 0x7fd098003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0affff640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b546e640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd098004d40 0x7fd0980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 -- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 msgr2=0x7fd098004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.302 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd098004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 -- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd098004d40 msgr2=0x7fd0980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd098004d40 0x7fd0980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b4c6d640 1 -- 172.21.15.113:0/1608017662 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098003520 con 0x7fd0980039e0 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0affff640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b015de30 0x7fd098004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.313+0000 7fd0b546e640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd098004d40 0x7fd0980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.314+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0980039e0 0x7fd098003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009a90 tx=0x7fd098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc50534c29db5a08 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.314+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0039070 con 0x7fd0980039e0 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.314+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a002c680 con 0x7fd0980039e0 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.314+0000 7fd0af7fe640 1 -- 172.21.15.113:0/1608017662 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0009690 con 0x7fd0980039e0 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1608017662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0980039e0 msgr2=0x7fd098003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1608017662 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0980039e0 0x7fd098003e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009a90 tx=0x7fd098005830 comp rx=0 tx=0).stop 2024-02-26T12:19:54.303 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b546e640 1 -- 172.21.15.113:0/1608017662 reap_dead start 2024-02-26T12:19:54.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1608017662 shutdown_connections 2024-02-26T12:19:54.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1608017662 >> 172.21.15.113:0/1608017662 conn(0x7fd0b00d0610 msgr2=0x7fd0b00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1608017662 shutdown_connections 2024-02-26T12:19:54.304 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.315+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1608017662 wait complete. 2024-02-26T12:19:54.306 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.316+0000 7fd0b6ed1640 1 Processor -- start 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.316+0000 7fd0b6ed1640 1 -- start start 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 0x7fd0b01f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b0160190 0x7fd0b01f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00b6dc0 con 0x7fd0b00b43a0 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0161d50 con 0x7fd0980039e0 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b6ed1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b015e210 con 0x7fd0b0160190 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53268/0 (socket says 172.21.15.113:53268) 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 -- 172.21.15.113:0/1745447719 learned_addr learned my addr 172.21.15.113:0/1745447719 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 0x7fd0b01f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.307 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0affff640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b0160190 0x7fd0b01f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 -- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b0160190 msgr2=0x7fd0b01f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b0160190 0x7fd0b01f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 -- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 msgr2=0x7fd0b01f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 0x7fd0b01f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 -- 172.21.15.113:0/1745447719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b01f38b0 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 0x7fd0b01f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.317+0000 7fd0b546e640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8000f80 tx=0x7fd0a800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.318+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8006b50 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.318+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8006d10 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.318+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b0160910 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.318+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8003970 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.318+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b0160ed0 con 0x7fd0b00b43a0 2024-02-26T12:19:54.308 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.319+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b0074a50 con 0x7fd0b00b43a0 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.319+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0a801a020 con 0x7fd0b00b43a0 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.319+0000 7fd0ad7fa640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 0x7fd09c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.319+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0a80897f0 con 0x7fd0b00b43a0 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.319+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 0x7fd09c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.320+0000 7fd0b4c6d640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 0x7fd09c06d9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0036000 tx=0x7fd0a0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.309 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.324+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0a8058700 con 0x7fd0b00b43a0 2024-02-26T12:19:54.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.496+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0b00d18d0 con 0x7fd0b00b43a0 2024-02-26T12:19:54.481 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.496+0000 7fd0ad7fa640 1 -- 172.21.15.113:0/1745447719 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0a8058000 con 0x7fd0b00b43a0 2024-02-26T12:19:54.481 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 msgr2=0x7fd09c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 0x7fd09c06d9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0036000 tx=0x7fd0a0030000 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 msgr2=0x7fd0b00b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8000f80 tx=0x7fd0a800eb90 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 shutdown_connections 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd09c06b500 0x7fd09c06d9c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0b00b43a0 0x7fd0b00b4820 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd0b0160190 0x7fd0b01f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 --2- 172.21.15.113:0/1745447719 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0980039e0 0x7fd0b01f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 >> 172.21.15.113:0/1745447719 conn(0x7fd0b00d0610 msgr2=0x7fd0b015d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 shutdown_connections 2024-02-26T12:19:54.484 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.498+0000 7fd0b6ed1640 1 -- 172.21.15.113:0/1745447719 wait complete. 2024-02-26T12:19:54.494 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:54.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.609+0000 7ff99a799640 1 Processor -- start 2024-02-26T12:19:54.594 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.609+0000 7ff99a799640 1 -- start start 2024-02-26T12:19:54.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff99a799640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff99406fd80 0x7ff99406ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.596 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff99a799640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99406b7a0 con 0x7ff99406e1e0 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff99a799640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99406ba80 con 0x7ff994070160 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff99a799640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99406e610 con 0x7ff99406fd80 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff99406fd80 0x7ff99406ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff99406fd80 0x7ff99406ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53276/0 (socket says 172.21.15.113:53276) 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff998d36640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff99406e1e0 0x7ff99415b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51226/0 (socket says 172.21.15.113:51226) 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 -- 172.21.15.113:0/2756594638 learned_addr learned my addr 172.21.15.113:0/2756594638 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 -- 172.21.15.113:0/2756594638 >> v1:172.21.15.152:6789/0 conn(0x7ff994070160 legacy=0x7ff99406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 -- 172.21.15.113:0/2756594638 >> v1:172.21.15.113:6789/0 conn(0x7ff99406e1e0 legacy=0x7ff99415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.597 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.610+0000 7ff993fff640 1 -- 172.21.15.113:0/2756594638 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99406bd60 con 0x7ff99406fd80 2024-02-26T12:19:54.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.611+0000 7ff993fff640 1 --2- 172.21.15.113:0/2756594638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406fd80 0x7ff99406ab50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff984009870 tx=0x7ff98402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f05b44402e6a1c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.611+0000 7ff992ffd640 1 -- 172.21.15.113:0/2756594638 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984034070 con 0x7ff99406fd80 2024-02-26T12:19:54.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.611+0000 7ff992ffd640 1 -- 172.21.15.113:0/2756594638 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984030860 con 0x7ff99406fd80 2024-02-26T12:19:54.599 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.611+0000 7ff992ffd640 1 -- 172.21.15.113:0/2756594638 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984030c30 con 0x7ff99406fd80 2024-02-26T12:19:54.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 -- 172.21.15.113:0/2756594638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406fd80 msgr2=0x7ff99406ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 --2- 172.21.15.113:0/2756594638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406fd80 0x7ff99406ab50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff984009870 tx=0x7ff98402b9a0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 -- 172.21.15.113:0/2756594638 shutdown_connections 2024-02-26T12:19:54.603 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 --2- 172.21.15.113:0/2756594638 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406fd80 0x7ff99406ab50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 -- 172.21.15.113:0/2756594638 >> 172.21.15.113:0/2756594638 conn(0x7ff9940cc970 msgr2=0x7ff9940ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 -- 172.21.15.113:0/2756594638 shutdown_connections 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.612+0000 7ff99a799640 1 -- 172.21.15.113:0/2756594638 wait complete. 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.613+0000 7ff99a799640 1 Processor -- start 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.613+0000 7ff99a799640 1 -- start start 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff99406fd80 0x7ff99414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 0x7ff99415c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cb700 con 0x7ff99406e1e0 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99406c320 con 0x7ff994070160 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cb880 con 0x7ff99406fd80 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.604 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53288/0 (socket says 172.21.15.113:53288) 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 -- 172.21.15.113:0/1255568624 learned_addr learned my addr 172.21.15.113:0/1255568624 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff998d36640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 0x7ff99415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 -- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff99406fd80 msgr2=0x7ff99414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff99406fd80 0x7ff99414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 -- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 msgr2=0x7ff99415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 0x7ff99415c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 -- 172.21.15.113:0/1255568624 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99414b860 con 0x7ff99406e1e0 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff998d36640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 0x7ff99415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff993fff640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff98402b9e0 tx=0x7ff984004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984048070 con 0x7ff99406e1e0 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984039d90 con 0x7ff99406e1e0 2024-02-26T12:19:54.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940a0910 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984034040 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.614+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940a0ed0 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.615+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff994074a50 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.616+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff98404b070 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.616+0000 7ff990ff9640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.616+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9840ac500 con 0x7ff99406e1e0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.616+0000 7ff9937fe640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.617+0000 7ff9937fe640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 0x7ff98006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff988000f60 tx=0x7ff9880079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.620+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff98407b410 con 0x7ff99406e1e0 2024-02-26T12:19:54.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.827+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff99406e9f0 con 0x7ff99406e1e0 2024-02-26T12:19:54.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.828+0000 7ff990ff9640 1 -- 172.21.15.113:0/1255568624 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7ff98407ad10 con 0x7ff99406e1e0 2024-02-26T12:19:54.813 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:54.813 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:54.813 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:54.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 msgr2=0x7ff98006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 0x7ff98006d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff988000f60 tx=0x7ff9880079d0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 msgr2=0x7ff9940a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff98402b9e0 tx=0x7ff984004730 comp rx=0 tx=0).stop 2024-02-26T12:19:54.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 shutdown_connections 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff994070160 0x7ff99415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff99406fd80 0x7ff99414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 --2- 172.21.15.113:0/1255568624 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff99406e1e0 0x7ff9940a01e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 >> 172.21.15.113:0/1255568624 conn(0x7ff9940cc970 msgr2=0x7ff9940b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 shutdown_connections 2024-02-26T12:19:54.816 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.830+0000 7ff99a799640 1 -- 172.21.15.113:0/1255568624 wait complete. 2024-02-26T12:19:54.826 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:54.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.940+0000 7f6fde8de640 1 Processor -- start 2024-02-26T12:19:54.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.940+0000 7f6fde8de640 1 -- start start 2024-02-26T12:19:54.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 0x7f6fd8154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6fd806d250 0x7f6fd80cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6fd806d6d0 0x7f6fd80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd8154b40 con 0x7f6fd806d250 2024-02-26T12:19:54.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd806e760 con 0x7f6fd806d6d0 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fde8de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd806db50 con 0x7f6fd815b340 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6fd806d250 0x7f6fd80cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6fd806d250 0x7f6fd80cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53294/0 (socket says 172.21.15.113:53294) 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 -- 172.21.15.113:0/1507457251 learned_addr learned my addr 172.21.15.113:0/1507457251 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fdce7b640 1 --2- 172.21.15.113:0/1507457251 >> v2:172.21.15.152:3300/0 conn(0x7f6fd806d6d0 0x7f6fd80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd7fff640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 0x7f6fd8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 -- 172.21.15.113:0/1507457251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 msgr2=0x7f6fd8154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 0x7f6fd8154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 -- 172.21.15.113:0/1507457251 >> v2:172.21.15.152:3300/0 conn(0x7f6fd806d6d0 msgr2=0x7f6fd80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/1507457251 >> v2:172.21.15.152:3300/0 conn(0x7f6fd806d6d0 0x7f6fd80711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd77fe640 1 -- 172.21.15.113:0/1507457251 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd806de30 con 0x7f6fd806d250 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.941+0000 7f6fd7fff640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 0x7f6fd8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.942+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd80cf700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cc770 tx=0x7f6fcc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91bb3368eba7280 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.942+0000 7f6fd6ffd640 1 -- 172.21.15.113:0/1507457251 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc035020 con 0x7f6fd806d250 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.942+0000 7f6fd6ffd640 1 -- 172.21.15.113:0/1507457251 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc031870 con 0x7f6fd806d250 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.942+0000 7f6fd6ffd640 1 -- 172.21.15.113:0/1507457251 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc031c40 con 0x7f6fd806d250 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 -- 172.21.15.113:0/1507457251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 msgr2=0x7f6fd80cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd80cf700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cc770 tx=0x7f6fcc02b910 comp rx=0 tx=0).stop 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 -- 172.21.15.113:0/1507457251 shutdown_connections 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 --2- 172.21.15.113:0/1507457251 >> v2:172.21.15.152:3300/0 conn(0x7f6fd806d6d0 0x7f6fd80711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd80cf700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 --2- 172.21.15.113:0/1507457251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd815b340 0x7f6fd8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 -- 172.21.15.113:0/1507457251 >> 172.21.15.113:0/1507457251 conn(0x7f6fd806ab50 msgr2=0x7f6fd806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 -- 172.21.15.113:0/1507457251 shutdown_connections 2024-02-26T12:19:54.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.943+0000 7f6fde8de640 1 -- 172.21.15.113:0/1507457251 wait complete. 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.944+0000 7f6fde8de640 1 Processor -- start 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.944+0000 7f6fde8de640 1 -- start start 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd806d6d0 0x7f6fd8158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 0x7f6fd8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80b3760 con 0x7f6fd806d250 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd806e3f0 con 0x7f6fd815b340 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fde8de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cfc40 con 0x7f6fd806d6d0 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53302/0 (socket says 172.21.15.113:53302) 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 -- 172.21.15.113:0/2847312987 learned_addr learned my addr 172.21.15.113:0/2847312987 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd806d6d0 0x7f6fd8158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fdce7b640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 0x7f6fd8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 -- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd806d6d0 msgr2=0x7f6fd8158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd806d6d0 0x7f6fd8158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 -- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 msgr2=0x7f6fd8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 0x7f6fd8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fd7fff640 1 -- 172.21.15.113:0/2847312987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8158d20 con 0x7f6fd806d250 2024-02-26T12:19:54.934 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.945+0000 7f6fdce7b640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 0x7f6fd8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fd7fff640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c7f0 tx=0x7f6fc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8015070 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8007820 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd81f5e60 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8007bd0 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.946+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd814d910 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.947+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd8074a50 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.947+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fc8018070 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.947+0000 7f6fd4ff9640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 0x7f6fc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.948+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 0x7f6fc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.948+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc808a280 con 0x7f6fd806d250 2024-02-26T12:19:54.935 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.948+0000 7f6fd77fe640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 0x7f6fc406d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc036000 tx=0x7f6fcc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:54.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:54.952+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fc8058ab0 con 0x7f6fd806d250 2024-02-26T12:19:55.109 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.123+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fd8071c90 con 0x7f6fd806d250 2024-02-26T12:19:55.110 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.124+0000 7f6fd4ff9640 1 -- 172.21.15.113:0/2847312987 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7f6fc805cb50 con 0x7f6fd806d250 2024-02-26T12:19:55.110 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:55.110 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 msgr2=0x7f6fc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 0x7f6fc406d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc036000 tx=0x7f6fcc03c040 comp rx=0 tx=0).stop 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 msgr2=0x7f6fd814e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c7f0 tx=0x7f6fc800ccb0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 shutdown_connections 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6fc406b4d0 0x7f6fc406d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.113 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6fd815b340 0x7f6fd8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6fd806d6d0 0x7f6fd8158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 --2- 172.21.15.113:0/2847312987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6fd806d250 0x7f6fd814e110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.126+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 >> 172.21.15.113:0/2847312987 conn(0x7f6fd806ab50 msgr2=0x7f6fd8150270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.127+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 shutdown_connections 2024-02-26T12:19:55.114 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.127+0000 7f6fde8de640 1 -- 172.21.15.113:0/2847312987 wait complete. 2024-02-26T12:19:55.123 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-26T12:19:55.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:55.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.240+0000 7ffa1a915640 1 Processor -- start 2024-02-26T12:19:55.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.240+0000 7ffa1a915640 1 -- start start 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa1a915640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa1406d250 0x7ffa1415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa1a915640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa1415bf80 0x7ffa1415c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa1a915640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1415eb60 con 0x7ffa140aed50 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa1a915640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa140af130 con 0x7ffa1415bf80 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa1a915640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1415ee40 con 0x7ffa1406d250 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa1415bf80 0x7ffa1415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.228 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa1415bf80 0x7ffa1415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53308/0 (socket says 172.21.15.113:53308) 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 -- 172.21.15.113:0/2256580216 learned_addr learned my addr 172.21.15.113:0/2256580216 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa137fe640 1 --2- 172.21.15.113:0/2256580216 >> v2:172.21.15.152:3300/0 conn(0x7ffa1406d250 0x7ffa1415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 -- 172.21.15.113:0/2256580216 >> v2:172.21.15.152:3300/0 conn(0x7ffa1406d250 msgr2=0x7ffa1415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 --2- 172.21.15.113:0/2256580216 >> v2:172.21.15.152:3300/0 conn(0x7ffa1406d250 0x7ffa1415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 -- 172.21.15.113:0/2256580216 >> v1:172.21.15.152:6789/0 conn(0x7ffa140aed50 legacy=0x7ffa140b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.241+0000 7ffa18eb2640 1 -- 172.21.15.113:0/2256580216 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1415f120 con 0x7ffa1415bf80 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.242+0000 7ffa18eb2640 1 --2- 172.21.15.113:0/2256580216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1415bf80 0x7ffa1415c380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa1406f500 tx=0x7ffa0c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a4aedd3117f889 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.242+0000 7ffa12ffd640 1 -- 172.21.15.113:0/2256580216 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c02ca80 con 0x7ffa1415bf80 2024-02-26T12:19:55.229 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.242+0000 7ffa12ffd640 1 -- 172.21.15.113:0/2256580216 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c02cc20 con 0x7ffa1415bf80 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.242+0000 7ffa12ffd640 1 -- 172.21.15.113:0/2256580216 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0343f0 con 0x7ffa1415bf80 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 -- 172.21.15.113:0/2256580216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1415bf80 msgr2=0x7ffa1415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 --2- 172.21.15.113:0/2256580216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1415bf80 0x7ffa1415c380 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa1406f500 tx=0x7ffa0c02bee0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 -- 172.21.15.113:0/2256580216 shutdown_connections 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 --2- 172.21.15.113:0/2256580216 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1415bf80 0x7ffa1415c380 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 --2- 172.21.15.113:0/2256580216 >> v2:172.21.15.152:3300/0 conn(0x7ffa1406d250 0x7ffa1415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 -- 172.21.15.113:0/2256580216 >> 172.21.15.113:0/2256580216 conn(0x7ffa1406ab50 msgr2=0x7ffa1406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 -- 172.21.15.113:0/2256580216 shutdown_connections 2024-02-26T12:19:55.230 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.243+0000 7ffa1a915640 1 -- 172.21.15.113:0/2256580216 wait complete. 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.244+0000 7ffa1a915640 1 Processor -- start 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.244+0000 7ffa1a915640 1 -- start start 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa140aed50 0x7ffa141f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 0x7ffa14158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140b4050 con 0x7ffa1406d250 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140b3420 con 0x7ffa1415bf80 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa1a915640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140b41d0 con 0x7ffa140aed50 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.233 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53322/0 (socket says 172.21.15.113:53322) 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 -- 172.21.15.113:0/1890602567 learned_addr learned my addr 172.21.15.113:0/1890602567 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa18eb2640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 0x7ffa14158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa137fe640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa140aed50 0x7ffa141f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 -- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa140aed50 msgr2=0x7ffa141f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa140aed50 0x7ffa141f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 -- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 msgr2=0x7ffa14158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 0x7ffa14158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 -- 172.21.15.113:0/1890602567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1414b7e0 con 0x7ffa1406d250 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa18eb2640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 0x7ffa14158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.245+0000 7ffa13fff640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c430 tx=0x7ffa0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.246+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04011790 con 0x7ffa1406d250 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.246+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa1406d250 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.246+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa141f7f10 con 0x7ffa1406d250 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.246+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04011bb0 con 0x7ffa1406d250 2024-02-26T12:19:55.234 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.246+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa14153cd0 con 0x7ffa1406d250 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.247+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa14074a50 con 0x7ffa1406d250 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.247+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa0401c460 con 0x7ffa1406d250 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.247+0000 7ffa10ff9640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 0x7ffa0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.248+0000 7ffa137fe640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 0x7ffa0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.248+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa0408a060 con 0x7ffa1406d250 2024-02-26T12:19:55.235 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.248+0000 7ffa137fe640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 0x7ffa0006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa140cc620 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.237 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.252+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa04058ee0 con 0x7ffa1406d250 2024-02-26T12:19:55.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.458+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa140ccad0 con 0x7ffa1406d250 2024-02-26T12:19:55.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.458+0000 7ffa10ff9640 1 -- 172.21.15.113:0/1890602567 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7ffa040587e0 con 0x7ffa1406d250 2024-02-26T12:19:55.444 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:55.444 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:55.444 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:55.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 msgr2=0x7ffa0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 0x7ffa0006d990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa140cc620 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 msgr2=0x7ffa1414b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c430 tx=0x7ffa0400c8f0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 shutdown_connections 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa0006b4d0 0x7ffa0006d990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa1415bf80 0x7ffa14158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa140aed50 0x7ffa141f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 --2- 172.21.15.113:0/1890602567 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa1406d250 0x7ffa1414b2a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 >> 172.21.15.113:0/1890602567 conn(0x7ffa1406ab50 msgr2=0x7ffa1406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 shutdown_connections 2024-02-26T12:19:55.446 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.460+0000 7ffa1a915640 1 -- 172.21.15.113:0/1890602567 wait complete. 2024-02-26T12:19:55.456 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:19:55.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.573+0000 7f63b1436640 1 Processor -- start 2024-02-26T12:19:55.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.573+0000 7f63b1436640 1 -- start start 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63b1436640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63ac0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63b1436640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0711d0 con 0x7f63ac15db00 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63b1436640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0714b0 con 0x7f63ac070c60 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63b1436640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac071790 con 0x7f63ac15dee0 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63aaffd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f63ac15db00 0x7f63ac0cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51230/0 (socket says 172.21.15.113:51230) 2024-02-26T12:19:55.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63aaffd640 1 -- 172.21.15.113:0/3160394348 learned_addr learned my addr 172.21.15.113:0/3160394348 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053419604 0 0) 0x7f63ac0711d0 con 0x7f63ac15db00 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63ac0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.574+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6394003520 con 0x7f63ac15db00 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2358431981 0 0) 0x7f6394003520 con 0x7f63ac15db00 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 msgr2=0x7f63ac0b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63ac0b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 >> v1:172.21.15.152:6789/0 conn(0x7f63ac070c60 legacy=0x7f63ac0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac071a70 con 0x7f63ac15db00 2024-02-26T12:19:55.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f639c001670 con 0x7f63ac15db00 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 >> v1:172.21.15.113:6789/0 conn(0x7f63ac15db00 legacy=0x7f63ac0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63940039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6394003f60 0x7f6394004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6394004d40 0x7f63940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac071790 con 0x7f6394004d40 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639400baa0 con 0x7f6394003f60 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639400bca0 con 0x7f63ac15dee0 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6394004d40 0x7f63940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63aaffd640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63940039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6394003f60 0x7f6394004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 -- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 msgr2=0x7f63940039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63940039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 -- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6394003f60 msgr2=0x7f6394004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.563 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6394003f60 0x7f6394004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63ab7fe640 1 -- 172.21.15.113:0/3160394348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394003520 con 0x7f6394004d40 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.575+0000 7f63aaffd640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac15dee0 0x7f63940039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.576+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6394004d40 0x7f63940051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63a4001e50 tx=0x7f6394005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207a0974561dbc24 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.576+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4001a70 con 0x7f6394004d40 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.576+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4003b70 con 0x7f6394004d40 2024-02-26T12:19:55.564 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.576+0000 7f63a9ffb640 1 -- 172.21.15.113:0/3160394348 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40050d0 con 0x7f6394004d40 2024-02-26T12:19:55.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 -- 172.21.15.113:0/3160394348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6394004d40 msgr2=0x7f63940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 --2- 172.21.15.113:0/3160394348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6394004d40 0x7f63940051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63a4001e50 tx=0x7f6394005830 comp rx=0 tx=0).stop 2024-02-26T12:19:55.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63ab7fe640 1 -- 172.21.15.113:0/3160394348 reap_dead start 2024-02-26T12:19:55.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 -- 172.21.15.113:0/3160394348 shutdown_connections 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 -- 172.21.15.113:0/3160394348 >> 172.21.15.113:0/3160394348 conn(0x7f63ac0ce350 msgr2=0x7f63ac0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 -- 172.21.15.113:0/3160394348 shutdown_connections 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.577+0000 7f63b1436640 1 -- 172.21.15.113:0/3160394348 wait complete. 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.578+0000 7f63b1436640 1 Processor -- start 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.578+0000 7f63b1436640 1 -- start start 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 0x7f63ac0c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 0x7f63ac0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac06c2d0 con 0x7f63ac156970 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac06c150 con 0x7f63ac0cab70 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0ccd00 con 0x7f63ac0c71f0 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.568 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53352/0 (socket says 172.21.15.113:53352) 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 -- 172.21.15.113:0/3305104876 learned_addr learned my addr 172.21.15.113:0/3305104876 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 0x7f63ac0c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 0x7f63ac0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 -- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 msgr2=0x7f63ac0c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 0x7f63ac0c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 -- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 msgr2=0x7f63ac0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 0x7f63ac0caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 -- 172.21.15.113:0/3305104876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac159990 con 0x7f63ac156970 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 0x7f63ac0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63ab7fe640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 0x7f63ac0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63aaffd640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f639c0017e0 tx=0x7f639c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00c6c0 con 0x7f63ac156970 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c00c860 con 0x7f63ac156970 2024-02-26T12:19:55.569 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac0c7d60 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00cc10 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.579+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac159e30 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.580+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac0cb530 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.581+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f639c020430 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.581+0000 7f63937fe640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 0x7f639806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.581+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f639c092940 con 0x7f63ac156970 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.581+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 0x7f639806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.582+0000 7f63aa7fc640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 0x7f639806d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f63ac159640 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.585+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f639c061200 con 0x7f63ac156970 2024-02-26T12:19:55.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.790+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63ac074a50 con 0x7f63ac156970 2024-02-26T12:19:55.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.791+0000 7f63937fe640 1 -- 172.21.15.113:0/3305104876 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f639c0652a0 con 0x7f63ac156970 2024-02-26T12:19:55.776 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:55.776 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6836/2317686675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2317686675},{"type":"v1","addr":"172.21.15.113:6836","nonce":2317686675}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/4129212043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6835","nonce":4129212043},{"type":"v1","addr":"172.21.15.113:6837","nonce":4129212043}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/2507494365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":2507494365},{"type":"v1","addr":"172.21.15.152:6835","nonce":2507494365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:19:18.806139+0000","modified":"2024-02-26T12:19:21.785857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6834/574691019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":574691019},{"type":"v1","addr":"172.21.15.152:6834","nonce":574691019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-26T12:19:55.776 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 7 2024-02-26T12:19:55.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 msgr2=0x7f639806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 0x7f639806d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f63ac159640 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2024-02-26T12:19:55.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 msgr2=0x7f63ac157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f639c0017e0 tx=0x7f639c007430 comp rx=0 tx=0).stop 2024-02-26T12:19:55.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 shutdown_connections 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f639806b4d0 0x7f639806d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63ac0cab70 0x7f63ac0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f63ac0c71f0 0x7f63ac0c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.792+0000 7f63b1436640 1 --2- 172.21.15.113:0/3305104876 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63ac156970 0x7f63ac157120 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.793+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 >> 172.21.15.113:0/3305104876 conn(0x7f63ac0ce350 msgr2=0x7f63ac160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.793+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 shutdown_connections 2024-02-26T12:19:55.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.793+0000 7f63b1436640 1 -- 172.21.15.113:0/3305104876 wait complete. 2024-02-26T12:19:55.789 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:19:55.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.904+0000 7fc5d1968640 1 Processor -- start 2024-02-26T12:19:55.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.904+0000 7fc5d1968640 1 -- start start 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5d1968640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc5cc15def0 0x7fc5cc0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5d1968640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0ce8b0 0x7fc5cc0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5d1968640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0d1f50 con 0x7fc5cc0b2d80 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5d1968640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0d2230 con 0x7fc5cc15def0 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5d1968640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0d2510 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5caffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc5cc15def0 0x7fc5cc0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5ca7fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc5cc0b2d80 0x7fc5cc0d2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51234/0 (socket says 172.21.15.113:51234) 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5ca7fc640 1 -- 172.21.15.113:0/2428474734 learned_addr learned my addr 172.21.15.113:0/2428474734 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5c9ffb640 1 -- 172.21.15.113:0/2428474734 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978446756 0 0) 0x7fc5cc0d1f50 con 0x7fc5cc0b2d80 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5cb7fe640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0ce8b0 0x7fc5cc0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5c9ffb640 1 -- 172.21.15.113:0/2428474734 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5b4003520 con 0x7fc5cc0b2d80 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5caffd640 1 -- 172.21.15.113:0/2428474734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0ce8b0 msgr2=0x7fc5cc0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5caffd640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0ce8b0 0x7fc5cc0ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5caffd640 1 -- 172.21.15.113:0/2428474734 >> v1:172.21.15.113:6789/0 conn(0x7fc5cc0b2d80 legacy=0x7fc5cc0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.905+0000 7fc5caffd640 1 -- 172.21.15.113:0/2428474734 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0d27f0 con 0x7fc5cc15def0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.906+0000 7fc5caffd640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc15def0 0x7fc5cc0b9400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0097d0 tx=0x7fc5bc02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c3d8c5ca8b6e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.906+0000 7fc5c9ffb640 1 -- 172.21.15.113:0/2428474734 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc035020 con 0x7fc5cc15def0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.906+0000 7fc5c9ffb640 1 -- 172.21.15.113:0/2428474734 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc031800 con 0x7fc5cc15def0 2024-02-26T12:19:55.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.906+0000 7fc5c9ffb640 1 -- 172.21.15.113:0/2428474734 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc031bd0 con 0x7fc5cc15def0 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 -- 172.21.15.113:0/2428474734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc15def0 msgr2=0x7fc5cc0b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc15def0 0x7fc5cc0b9400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0097d0 tx=0x7fc5bc02b8a0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 -- 172.21.15.113:0/2428474734 shutdown_connections 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0ce8b0 0x7fc5cc0ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 --2- 172.21.15.113:0/2428474734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc15def0 0x7fc5cc0b9400 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 -- 172.21.15.113:0/2428474734 >> 172.21.15.113:0/2428474734 conn(0x7fc5cc0728b0 msgr2=0x7fc5cc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 -- 172.21.15.113:0/2428474734 shutdown_connections 2024-02-26T12:19:55.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.907+0000 7fc5d1968640 1 -- 172.21.15.113:0/2428474734 wait complete. 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.908+0000 7fc5d1968640 1 Processor -- start 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.908+0000 7fc5d1968640 1 -- start start 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0b2d80 0x7fc5cc1f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 0x7fc5cc15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b9940 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0d3700 con 0x7fc5cc0b2110 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5d1968640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b9ac0 con 0x7fc5cc0b2d80 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53376/0 (socket says 172.21.15.113:53376) 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 -- 172.21.15.113:0/629074583 learned_addr learned my addr 172.21.15.113:0/629074583 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5caffd640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0b2d80 0x7fc5cc1f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5cb7fe640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 0x7fc5cc15f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 -- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0b2d80 msgr2=0x7fc5cc1f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0b2d80 0x7fc5cc1f4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 -- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 msgr2=0x7fc5cc15f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 0x7fc5cc15f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 -- 172.21.15.113:0/629074583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc1f45d0 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5cb7fe640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 0x7fc5cc15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5ca7fc640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0001eb0 tx=0x7fc5c000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.909+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0017070 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.910+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c0005d00 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.910+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0007310 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.910+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc0aa710 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.910+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc0aacd0 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.910+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc074a50 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.911+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5c001a070 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.911+0000 7fc5b3fff640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 0x7fc5b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.911+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5c0089490 con 0x7fc5cc0ce8b0 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.911+0000 7fc5caffd640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 0x7fc5b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:55.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.912+0000 7fc5caffd640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 0x7fc5b806d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc036000 tx=0x7fc5bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:55.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:55.916+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5c0057d50 con 0x7fc5cc0ce8b0 2024-02-26T12:19:56.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.087+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5cc0aa420 con 0x7fc5cc0ce8b0 2024-02-26T12:19:56.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.088+0000 7fc5b3fff640 1 -- 172.21.15.113:0/629074583 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16629 (secure 0 0 0) 0x7fc5c005bdf0 con 0x7fc5cc0ce8b0 2024-02-26T12:19:56.074 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:19:56.074 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":20,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:19:20.445213+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:19:17.081697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-26T12:19:17.763671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 msgr2=0x7fc5b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 0x7fc5b806d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc036000 tx=0x7fc5bc008030 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 msgr2=0x7fc5cc1f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0001eb0 tx=0x7fc5c000c820 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 shutdown_connections 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc5b806b4d0 0x7fc5b806d990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0b2110 0x7fc5cc15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc5cc0ce8b0 0x7fc5cc1f4800 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 --2- 172.21.15.113:0/629074583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5cc0b2d80 0x7fc5cc1f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.090+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 >> 172.21.15.113:0/629074583 conn(0x7fc5cc0728b0 msgr2=0x7fc5cc0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:56.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.091+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 shutdown_connections 2024-02-26T12:19:56.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.091+0000 7fc5d1968640 1 -- 172.21.15.113:0/629074583 wait complete. 2024-02-26T12:19:56.087 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-26T12:19:56.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.203+0000 7fdcbe315640 1 Processor -- start 2024-02-26T12:19:56.189 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.203+0000 7fdcbe315640 1 -- start start 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbe315640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80d04e0 0x7fdcb80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbe315640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdcb80b7270 0x7fdcb80b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbe315640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80b6db0 con 0x7fdcb80cedd0 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbe315640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80d2e10 con 0x7fdcb80b7270 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbe315640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80d30f0 con 0x7fdcb80d04e0 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbc8b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdcb80b7270 0x7fdcb80b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbc8b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdcb80b7270 0x7fdcb80b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53388/0 (socket says 172.21.15.113:53388) 2024-02-26T12:19:56.190 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/484814648 learned_addr learned my addr 172.21.15.113:0/484814648 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.204+0000 7fdcb7fff640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80d04e0 0x7fdcb80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/484814648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80d04e0 msgr2=0x7fdcb80d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcbc8b2640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80d04e0 0x7fdcb80d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/484814648 >> v1:172.21.15.152:6789/0 conn(0x7fdcb80cedd0 legacy=0x7fdcb80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.191 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/484814648 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80d33d0 con 0x7fdcb80b7270 2024-02-26T12:19:56.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcbc8b2640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80b7270 0x7fdcb80b7700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009e50 tx=0x7fdcb002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b34cb86e31bf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.192 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.205+0000 7fdcb6ffd640 1 -- 172.21.15.113:0/484814648 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb002ca70 con 0x7fdcb80b7270 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcb6ffd640 1 -- 172.21.15.113:0/484814648 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb002cc10 con 0x7fdcb80b7270 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcb6ffd640 1 -- 172.21.15.113:0/484814648 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00343f0 con 0x7fdcb80b7270 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 -- 172.21.15.113:0/484814648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80b7270 msgr2=0x7fdcb80b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80b7270 0x7fdcb80b7700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009e50 tx=0x7fdcb002bed0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 -- 172.21.15.113:0/484814648 shutdown_connections 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80b7270 0x7fdcb80b7700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 --2- 172.21.15.113:0/484814648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80d04e0 0x7fdcb80d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 -- 172.21.15.113:0/484814648 >> 172.21.15.113:0/484814648 conn(0x7fdcb80728b0 msgr2=0x7fdcb80b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 -- 172.21.15.113:0/484814648 shutdown_connections 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.206+0000 7fdcbe315640 1 -- 172.21.15.113:0/484814648 wait complete. 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.207+0000 7fdcbe315640 1 Processor -- start 2024-02-26T12:19:56.193 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.207+0000 7fdcbe315640 1 -- start start 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcb80b7270 0x7fdcb81f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 0x7fdcb81f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80cf230 con 0x7fdcb80d04e0 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb815e050 con 0x7fdcb80b7270 2024-02-26T12:19:56.196 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbe315640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80b7c40 con 0x7fdcb80cedd0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbc8b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbc8b2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53400/0 (socket says 172.21.15.113:53400) 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/3331404912 learned_addr learned my addr 172.21.15.113:0/3331404912 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcb7fff640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcb80b7270 0x7fdcb81f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.208+0000 7fdcb77fe640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 0x7fdcb81f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 msgr2=0x7fdcb81f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 0x7fdcb81f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcb80b7270 msgr2=0x7fdcb81f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcb80b7270 0x7fdcb81f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 -- 172.21.15.113:0/3331404912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb81f4d50 con 0x7fdcb80d04e0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcb77fe640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 0x7fdcb81f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbc8b2640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0036040 tx=0x7fdcb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.197 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0043020 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb003e450 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb80cc7b0 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0009510 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.209+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb80ccd70 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.210+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb8074a50 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.210+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdcb0046020 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.211+0000 7fdcb4ff9640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.211+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcb00ac8c0 con 0x7fdcb80d04e0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.211+0000 7fdcb7fff640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.198 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.211+0000 7fdcb7fff640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 0x7fdca406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009aa0 tx=0x7fdca8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.200 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.215+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcb004d030 con 0x7fdcb80d04e0 2024-02-26T12:19:56.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.420+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdcb80ce9e0 con 0x7fdcb80d04e0 2024-02-26T12:19:56.406 INFO:tasks.ceph.mon.a.smithi113.stderr:2024-02-26T12:19:56.421+0000 7f8d8608a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-26T12:19:56.407 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.422+0000 7fdcb4ff9640 1 -- 172.21.15.113:0/3331404912 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdcb007b740 con 0x7fdcb80d04e0 2024-02-26T12:19:56.407 INFO:teuthology.orchestra.run.smithi113.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 msgr2=0x7fdca406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 0x7fdca406d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009aa0 tx=0x7fdca8009190 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 msgr2=0x7fdcb80c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0036040 tx=0x7fdcb0004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 shutdown_connections 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdca406b4d0 0x7fdca406d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdcb80d04e0 0x7fdcb80c8570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcb80cedd0 0x7fdcb81f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 --2- 172.21.15.113:0/3331404912 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcb80b7270 0x7fdcb81f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.411 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 >> 172.21.15.113:0/3331404912 conn(0x7fdcb80728b0 msgr2=0x7fdcb80d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:56.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 shutdown_connections 2024-02-26T12:19:56.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.425+0000 7fdcbe315640 1 -- 172.21.15.113:0/3331404912 wait complete. 2024-02-26T12:19:56.415 INFO:tasks.ceph.mds.d.smithi152.stderr: -6702> 2024-02-26T12:19:23.701+0000 7f5a8bff1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-26T12:19:56.421 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-26T12:19:56.449 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2024-02-26T12:19:56.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.539+0000 7fe567b84640 1 Processor -- start 2024-02-26T12:19:56.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.539+0000 7fe567b84640 1 -- start start 2024-02-26T12:19:56.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe567b84640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe560154eb0 0x7fe56006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe567b84640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56015b430 con 0x7fe5600cb3b0 2024-02-26T12:19:56.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe567b84640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56015b710 con 0x7fe56015af30 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe567b84640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600ce360 con 0x7fe560154eb0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe566121640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe5600cb3b0 0x7fe5600ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51242/0 (socket says 172.21.15.113:51242) 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe566121640 1 -- 172.21.15.113:0/2784916656 learned_addr learned my addr 172.21.15.113:0/2784916656 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe565920640 1 --2- 172.21.15.113:0/2784916656 >> v2:172.21.15.152:3300/0 conn(0x7fe560154eb0 0x7fe56006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe56491e640 1 -- 172.21.15.113:0/2784916656 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291380254 0 0) 0x7fe56015b430 con 0x7fe5600cb3b0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.540+0000 7fe56491e640 1 -- 172.21.15.113:0/2784916656 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe54c003520 con 0x7fe5600cb3b0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.541+0000 7fe565920640 1 -- 172.21.15.113:0/2784916656 >> v1:172.21.15.152:6789/0 conn(0x7fe56015af30 legacy=0x7fe560071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.541+0000 7fe565920640 1 -- 172.21.15.113:0/2784916656 >> v1:172.21.15.113:6789/0 conn(0x7fe5600cb3b0 legacy=0x7fe5600ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.541+0000 7fe565920640 1 -- 172.21.15.113:0/2784916656 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56015b9f0 con 0x7fe560154eb0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.541+0000 7fe565920640 1 --2- 172.21.15.113:0/2784916656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56006f2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009d90 tx=0x7fe55c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c902d17f0c07ea63 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.541+0000 7fe56491e640 1 -- 172.21.15.113:0/2784916656 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c039070 con 0x7fe560154eb0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe56491e640 1 -- 172.21.15.113:0/2784916656 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c02cc60 con 0x7fe560154eb0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe56491e640 1 -- 172.21.15.113:0/2784916656 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c034640 con 0x7fe560154eb0 2024-02-26T12:19:56.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 -- 172.21.15.113:0/2784916656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 msgr2=0x7fe56006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 --2- 172.21.15.113:0/2784916656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56006f2b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009d90 tx=0x7fe55c02beb0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 -- 172.21.15.113:0/2784916656 shutdown_connections 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 --2- 172.21.15.113:0/2784916656 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56006f2b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 -- 172.21.15.113:0/2784916656 >> 172.21.15.113:0/2784916656 conn(0x7fe5600cc100 msgr2=0x7fe5600cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 -- 172.21.15.113:0/2784916656 shutdown_connections 2024-02-26T12:19:56.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.542+0000 7fe567b84640 1 -- 172.21.15.113:0/2784916656 wait complete. 2024-02-26T12:19:56.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.543+0000 7fe567b84640 1 Processor -- start 2024-02-26T12:19:56.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.543+0000 7fe567b84640 1 -- start start 2024-02-26T12:19:56.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 0x7fe56014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600ccf60 con 0x7fe5600cb3b0 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600ccde0 con 0x7fe560154eb0 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe567b84640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe560155290 con 0x7fe56015af30 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53414/0 (socket says 172.21.15.113:53414) 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 -- 172.21.15.113:0/1309025691 learned_addr learned my addr 172.21.15.113:0/1309025691 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe56511f640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe566121640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 0x7fe56014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 -- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 msgr2=0x7fe56014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 0x7fe56014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 -- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 msgr2=0x7fe56014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56014d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:56.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe565920640 1 -- 172.21.15.113:0/1309025691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600b3e30 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.544+0000 7fe566121640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 0x7fe56014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe565920640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe55c037040 tx=0x7fe55c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c039040 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c003990 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c003d60 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5600b40d0 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.545+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5600b4690 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.546+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe560068670 con 0x7fe5600cb3b0 2024-02-26T12:19:56.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.546+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe55c004030 con 0x7fe5600cb3b0 2024-02-26T12:19:56.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.547+0000 7fe5567fc640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 0x7fe54406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:56.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.547+0000 7fe56511f640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 0x7fe54406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:56.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.547+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe55c0ad3a0 con 0x7fe5600cb3b0 2024-02-26T12:19:56.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.547+0000 7fe56511f640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 0x7fe54406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe550007fd0 tx=0x7fe550009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:56.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.551+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe560068670 con 0x7fe5600cb3b0 2024-02-26T12:19:56.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:56.762+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe560074a50 con 0x7fe5600cb3b0 2024-02-26T12:19:57.409 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.424+0000 7fe5567fc640 1 -- 172.21.15.113:0/1309025691 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe55c07c1d0 con 0x7fe5600cb3b0 2024-02-26T12:19:57.412 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 msgr2=0x7fe54406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 0x7fe54406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe550007fd0 tx=0x7fe550009040 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 msgr2=0x7fe56014a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe55c037040 tx=0x7fe55c004a40 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 shutdown_connections 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe54406b4d0 0x7fe54406d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe56015af30 0x7fe56014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe560154eb0 0x7fe56014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 --2- 172.21.15.113:0/1309025691 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe5600cb3b0 0x7fe56014a130 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 >> 172.21.15.113:0/1309025691 conn(0x7fe5600cc100 msgr2=0x7fe5600cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 shutdown_connections 2024-02-26T12:19:57.413 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.427+0000 7fe567b84640 1 -- 172.21.15.113:0/1309025691 wait complete. 2024-02-26T12:19:57.425 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-26T12:19:57.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.545+0000 7fe7728d1640 1 Processor -- start 2024-02-26T12:19:57.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.545+0000 7fe7728d1640 1 -- start start 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe7728d1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe76c0ce560 0x7fe76c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe7728d1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0ce110 con 0x7fe76c0cba90 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe7728d1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0cd350 con 0x7fe76c0aee00 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe7728d1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c0b2570 con 0x7fe76c0ce560 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe770e6e640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe76c0cba90 0x7fe76c15e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:51250/0 (socket says 172.21.15.113:51250) 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe770e6e640 1 -- 172.21.15.113:0/3562135466 learned_addr learned my addr 172.21.15.113:0/3562135466 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3562135466 >> v2:172.21.15.152:3300/0 conn(0x7fe76c0ce560 0x7fe76c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.546+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925609158 0 0) 0x7fe76c0ce110 con 0x7fe76c0cba90 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe754003520 con 0x7fe76c0cba90 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498096259 0 0) 0x7fe754003520 con 0x7fe76c0cba90 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 >> v2:172.21.15.152:3300/0 conn(0x7fe76c0ce560 msgr2=0x7fe76c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 --2- 172.21.15.113:0/3562135466 >> v2:172.21.15.152:3300/0 conn(0x7fe76c0ce560 0x7fe76c0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 >> v1:172.21.15.152:6789/0 conn(0x7fe76c0aee00 legacy=0x7fe76c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0cd630 con 0x7fe76c0cba90 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe7640019f0 con 0x7fe76c0cba90 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 >> v1:172.21.15.113:6789/0 conn(0x7fe76c0cba90 legacy=0x7fe76c15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 0x7fe754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7540051c0 0x7fe75400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75400c130 con 0x7fe754004800 2024-02-26T12:19:57.535 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75400c2e0 con 0x7fe7540051c0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75400c4e0 con 0x7fe7540039b0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 0x7fe754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76bfff640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe770e6e640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7540051c0 0x7fe75400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 -- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7540039b0 msgr2=0x7fe754003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7540039b0 0x7fe754003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 -- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7540051c0 msgr2=0x7fe75400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7540051c0 0x7fe75400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe770e6e640 1 -- 172.21.15.113:0/3562135466 reap_dead start 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.547+0000 7fe76b7fe640 1 -- 172.21.15.113:0/3562135466 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754003520 con 0x7fe754004800 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 0x7fe754004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe760009650 tx=0x7fe754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e5c4bafc17efd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76003b070 con 0x7fe754004800 2024-02-26T12:19:57.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76002e8c0 con 0x7fe754004800 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe76affd640 1 -- 172.21.15.113:0/3562135466 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760009690 con 0x7fe754004800 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe7728d1640 1 -- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 msgr2=0x7fe754004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.548+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 0x7fe754004c80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe760009650 tx=0x7fe754005830 comp rx=0 tx=0).stop 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.549+0000 7fe7728d1640 1 -- 172.21.15.113:0/3562135466 shutdown_connections 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.549+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3562135466 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe754004800 0x7fe754004c80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.549+0000 7fe7728d1640 1 -- 172.21.15.113:0/3562135466 >> 172.21.15.113:0/3562135466 conn(0x7fe76c0cf6e0 msgr2=0x7fe76c0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.549+0000 7fe7728d1640 1 -- 172.21.15.113:0/3562135466 shutdown_connections 2024-02-26T12:19:57.537 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.549+0000 7fe7728d1640 1 -- 172.21.15.113:0/3562135466 wait complete. 2024-02-26T12:19:57.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.550+0000 7fe7728d1640 1 Processor -- start 2024-02-26T12:19:57.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.550+0000 7fe7728d1640 1 -- start start 2024-02-26T12:19:57.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 0x7fe76c158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe76c1f4630 0x7fe76c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0cf350 con 0x7fe76c0c8150 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0cdbf0 con 0x7fe76c1f4630 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0c9dc0 con 0x7fe754004800 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:53434/0 (socket says 172.21.15.113:53434) 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 -- 172.21.15.113:0/3101916114 learned_addr learned my addr 172.21.15.113:0/3101916114 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe76b7fe640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe76c1f4630 0x7fe76c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe76bfff640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 0x7fe76c158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 -- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 msgr2=0x7fe76c158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 0x7fe76c158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 -- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe76c1f4630 msgr2=0x7fe76c0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:57.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe76c1f4630 0x7fe76c0c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 -- 172.21.15.113:0/3101916114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c1591c0 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe76bfff640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 0x7fe76c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe770e6e640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ce940 tx=0x7fe76400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400eb90 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764018070 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c0c70b0 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764013420 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.551+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c0c7670 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.552+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c074a50 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.553+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe7640135c0 con 0x7fe76c0c8150 2024-02-26T12:19:57.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.553+0000 7fe768ff9640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 0x7fe75806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:57.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.553+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe76408a540 con 0x7fe76c0c8150 2024-02-26T12:19:57.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.553+0000 7fe76bfff640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 0x7fe75806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:57.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.554+0000 7fe76bfff640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 0x7fe75806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000c00 tx=0x7fe75c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:57.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.558+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe76c1591c0 con 0x7fe76c0c8150 2024-02-26T12:19:57.718 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:57.733+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe76c0af1e0 con 0x7fe76c0c8150 2024-02-26T12:19:58.562 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.577+0000 7fe768ff9640 1 -- 172.21.15.113:0/3101916114 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe7640593f0 con 0x7fe76c0c8150 2024-02-26T12:19:58.562 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' removed 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 msgr2=0x7fe75806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 0x7fe75806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000c00 tx=0x7fe75c009040 comp rx=0 tx=0).stop 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 msgr2=0x7fe76c0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ce940 tx=0x7fe76400e530 comp rx=0 tx=0).stop 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 shutdown_connections 2024-02-26T12:19:58.566 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe75806b4d0 0x7fe75806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe76c0c8150 0x7fe76c0c85e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe76c1f4630 0x7fe76c0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 --2- 172.21.15.113:0/3101916114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe754004800 0x7fe76c158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 >> 172.21.15.113:0/3101916114 conn(0x7fe76c0cf6e0 msgr2=0x7fe76c0b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 shutdown_connections 2024-02-26T12:19:58.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.581+0000 7fe7728d1640 1 -- 172.21.15.113:0/3101916114 wait complete. 2024-02-26T12:19:58.580 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-26T12:19:58.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.705+0000 7fc3af2b0640 1 Processor -- start 2024-02-26T12:19:58.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.705+0000 7fc3af2b0640 1 -- start start 2024-02-26T12:19:58.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3af2b0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc3a809a150 0x7fc3a80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3af2b0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80d0d10 con 0x7fc3a80b2a80 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3af2b0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a80d0ff0 con 0x7fc3a815df90 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3af2b0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a80cbf80 con 0x7fc3a809a150 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3ad84d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc3a80b2a80 0x7fc3a80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57384/0 (socket says 172.21.15.113:57384) 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3ad84d640 1 -- 172.21.15.113:0/2501090585 learned_addr learned my addr 172.21.15.113:0/2501090585 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/2501090585 >> v2:172.21.15.152:3300/0 conn(0x7fc3a809a150 0x7fc3a80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103092138 0 0) 0x7fc3a80d0d10 con 0x7fc3a80b2a80 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc394003520 con 0x7fc3a80b2a80 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148463457 0 0) 0x7fc394003520 con 0x7fc3a80b2a80 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 >> v2:172.21.15.152:3300/0 conn(0x7fc3a809a150 msgr2=0x7fc3a80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 --2- 172.21.15.113:0/2501090585 >> v2:172.21.15.152:3300/0 conn(0x7fc3a809a150 0x7fc3a80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 >> v1:172.21.15.152:6789/0 conn(0x7fc3a815df90 legacy=0x7fc3a8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80d12d0 con 0x7fc3a80b2a80 2024-02-26T12:19:58.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fc3a00019f0 con 0x7fc3a80b2a80 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 >> v1:172.21.15.113:6789/0 conn(0x7fc3a80b2a80 legacy=0x7fc3a80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc394003a00 0x7fc394003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 0x7fc394004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.706+0000 7fc39ffff640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3940051c0 0x7fc39400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80cbf80 con 0x7fc394004800 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400c0c0 con 0x7fc3940051c0 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400c2c0 con 0x7fc394003a00 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 0x7fc394004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc394003a00 0x7fc394003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ad84d640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3940051c0 0x7fc39400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 -- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc394003a00 msgr2=0x7fc394003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc394003a00 0x7fc394003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 -- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3940051c0 msgr2=0x7fc39400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3940051c0 0x7fc39400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ac84b640 1 -- 172.21.15.113:0/2501090585 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394003520 con 0x7fc394004800 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ad84d640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc3940051c0 0x7fc39400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc394003a00 0x7fc394003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.707+0000 7fc3ad84d640 1 -- 172.21.15.113:0/2501090585 reap_dead start 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 0x7fc394004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc398009ac0 tx=0x7fc394005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568114c50ef22f46 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398039070 con 0x7fc394004800 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39802c6b0 con 0x7fc394004800 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc39ffff640 1 -- 172.21.15.113:0/2501090585 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398009690 con 0x7fc394004800 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 -- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 msgr2=0x7fc394004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 0x7fc394004c80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc398009ac0 tx=0x7fc394005830 comp rx=0 tx=0).stop 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 -- 172.21.15.113:0/2501090585 shutdown_connections 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/2501090585 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc394004800 0x7fc394004c80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 -- 172.21.15.113:0/2501090585 >> 172.21.15.113:0/2501090585 conn(0x7fc3a80b3390 msgr2=0x7fc3a80b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:58.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 -- 172.21.15.113:0/2501090585 shutdown_connections 2024-02-26T12:19:58.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.708+0000 7fc3af2b0640 1 -- 172.21.15.113:0/2501090585 wait complete. 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.709+0000 7fc3af2b0640 1 Processor -- start 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.709+0000 7fc3af2b0640 1 -- start start 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 0x7fc3a814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 0x7fc3a80c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80b2eb0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a815e370 con 0x7fc394004800 2024-02-26T12:19:58.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3af2b0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80d0680 con 0x7fc3a80c8970 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3ad84d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3ad84d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58322/0 (socket says 172.21.15.113:58322) 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3ad84d640 1 -- 172.21.15.113:0/3783513822 learned_addr learned my addr 172.21.15.113:0/3783513822 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.710+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 0x7fc3a80c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 0x7fc3a814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 -- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 msgr2=0x7fc3a80c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 0x7fc3a80c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 -- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 msgr2=0x7fc3a814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 0x7fc3a814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 -- 172.21.15.113:0/3783513822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a81501c0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ac84b640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 0x7fc3a80c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:58.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 0x7fc3a814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3ad84d640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0001350 tx=0x7fc3a000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000eb90 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0018070 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a814f2c0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0013420 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.711+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a8150720 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.712+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a806ddc0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.712+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3a00135c0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.713+0000 7fc39dffb640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 0x7fc38c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.713+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fc3a008a4e0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.713+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 0x7fc38c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:58.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.713+0000 7fc3ad04c640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 0x7fc38c06d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8068350 tx=0x7fc3a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:58.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.717+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3a81501c0 con 0x7fc3a814f7f0 2024-02-26T12:19:58.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:58.889+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc3a8074a50 con 0x7fc3a814f7f0 2024-02-26T12:19:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.582+0000 7fc39dffb640 1 -- 172.21.15.113:0/3783513822 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc3a0059420 con 0x7fc3a814f7f0 2024-02-26T12:19:59.567 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' removed 2024-02-26T12:19:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 msgr2=0x7fc38c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 0x7fc38c06d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8068350 tx=0x7fc3a4009040 comp rx=0 tx=0).stop 2024-02-26T12:19:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 msgr2=0x7fc3a814fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0001350 tx=0x7fc3a000e530 comp rx=0 tx=0).stop 2024-02-26T12:19:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 shutdown_connections 2024-02-26T12:19:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc38c06b4d0 0x7fc38c06d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3a814f7f0 0x7fc3a814fc80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.585+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc3a80c8970 0x7fc3a80c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.586+0000 7fc3af2b0640 1 --2- 172.21.15.113:0/3783513822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc394004800 0x7fc3a814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.586+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 >> 172.21.15.113:0/3783513822 conn(0x7fc3a80b3390 msgr2=0x7fc3a8070170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.586+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 shutdown_connections 2024-02-26T12:19:59.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.586+0000 7fc3af2b0640 1 -- 172.21.15.113:0/3783513822 wait complete. 2024-02-26T12:19:59.585 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-26T12:19:59.585 INFO:tasks.ceph.mds.a:Stopping old one... 2024-02-26T12:19:59.585 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-26T12:19:59.585 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:19:59.585 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-26T12:19:59.586 INFO:tasks.ceph.mds.c:Stopping old one... 2024-02-26T12:19:59.586 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-26T12:19:59.586 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:19:59.586 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-26T12:19:59.586 INFO:tasks.ceph.mds.b:Stopping old one... 2024-02-26T12:19:59.586 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-26T12:19:59.586 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:19:59.587 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-26T12:19:59.587 INFO:tasks.ceph.mds.d:Stopping old one... 2024-02-26T12:19:59.587 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-26T12:19:59.587 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:19:59.596 INFO:tasks.ceph.mds.a:Stopped 2024-02-26T12:19:59.597 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-26T12:19:59.597 INFO:tasks.ceph.mds.c:Stopped 2024-02-26T12:19:59.598 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-26T12:19:59.599 INFO:tasks.ceph.mds.b:Stopped 2024-02-26T12:19:59.599 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-26T12:19:59.600 INFO:tasks.ceph.mds.d:Stopped 2024-02-26T12:19:59.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-26T12:19:59.641 INFO:tasks.ceph.mds.a:Started 2024-02-26T12:19:59.642 INFO:tasks.ceph.mds.c:Started 2024-02-26T12:19:59.642 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:59.643 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:59.644 INFO:tasks.ceph.mds.b:Started 2024-02-26T12:19:59.645 INFO:tasks.ceph.mds.d:Started 2024-02-26T12:19:59.645 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:59.645 DEBUG:teuthology.parallel:result is None 2024-02-26T12:19:59.646 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-02-26T12:19:59.716 INFO:tasks.ceph.mds.c.smithi113.stdout:starting mds.c at 2024-02-26T12:19:59.717 INFO:tasks.ceph.mds.a.smithi113.stdout:starting mds.a at 2024-02-26T12:19:59.723 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2024-02-26T12:19:59.723 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2024-02-26T12:19:59.724 INFO:tasks.ceph.mds.b.smithi152.stderr:2024-02-26T12:19:59.739+0000 7fc939dfd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-02-26T12:19:59.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.767+0000 7f3e8a3f0640 1 Processor -- start 2024-02-26T12:19:59.753 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.767+0000 7f3e8a3f0640 1 -- start start 2024-02-26T12:19:59.756 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e8a3f0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3e840b8280 0x7f3e841688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e8a3f0640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840b6db0 con 0x7f3e840d04e0 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e8a3f0640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840d2e10 con 0x7f3e840d2780 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e8a3f0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840d2bf0 con 0x7f3e840b8280 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e83fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e840d04e0 0x7f3e840cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57388/0 (socket says 172.21.15.113:57388) 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.768+0000 7f3e83fff640 1 -- 172.21.15.113:0/2976941203 learned_addr learned my addr 172.21.15.113:0/2976941203 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 --2- 172.21.15.113:0/2976941203 >> v2:172.21.15.152:3300/0 conn(0x7f3e840b8280 0x7f3e841688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527389260 0 0) 0x7f3e74001110 con 0x7f3e840d04e0 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e6c003520 con 0x7f3e840d04e0 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641799858 0 0) 0x7f3e6c003520 con 0x7f3e840d04e0 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 >> v2:172.21.15.152:3300/0 conn(0x7f3e840b8280 msgr2=0x7f3e841688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 --2- 172.21.15.113:0/2976941203 >> v2:172.21.15.152:3300/0 conn(0x7f3e840b8280 0x7f3e841688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 >> v1:172.21.15.152:6789/0 conn(0x7f3e840d2780 legacy=0x7f3e840d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.757 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840d30f0 con 0x7f3e840d04e0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f3e74001840 con 0x7f3e840d04e0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 >> v1:172.21.15.113:6789/0 conn(0x7f3e840d04e0 legacy=0x7f3e840cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0039b0 0x7f3e6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c004800 0x7f3e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 0x7f3e6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840d2bf0 con 0x7f3e6c0051c0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c00c160 con 0x7f3e6c0039b0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c00c360 con 0x7f3e6c004800 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 0x7f3e6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e83fff640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0039b0 0x7f3e6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e837fe640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c004800 0x7f3e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 -- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c004800 msgr2=0x7f3e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c004800 0x7f3e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 -- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0039b0 msgr2=0x7f3e6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0039b0 0x7f3e6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e8898d640 1 -- 172.21.15.113:0/2976941203 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c003520 con 0x7f3e6c0051c0 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.769+0000 7f3e83fff640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0039b0 0x7f3e6c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.770+0000 7f3e8898d640 1 -- 172.21.15.113:0/2976941203 reap_dead start 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.770+0000 7f3e8898d640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 0x7f3e6c00b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009fc0 tx=0x7f3e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175a53e8f90cd5f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.770+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400c0e0 con 0x7f3e6c0051c0 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.770+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c02cca0 con 0x7f3e6c0051c0 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.770+0000 7f3e82ffd640 1 -- 172.21.15.113:0/2976941203 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c009c10 con 0x7f3e6c0051c0 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 msgr2=0x7f3e6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 0x7f3e6c00b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009fc0 tx=0x7f3e6c005830 comp rx=0 tx=0).stop 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/2976941203 shutdown_connections 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/2976941203 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e6c0051c0 0x7f3e6c00b9c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/2976941203 >> 172.21.15.113:0/2976941203 conn(0x7f3e840728b0 msgr2=0x7f3e840b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:19:59.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/2976941203 shutdown_connections 2024-02-26T12:19:59.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.771+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/2976941203 wait complete. 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.772+0000 7f3e8a3f0640 1 Processor -- start 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 -- start start 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0051c0 0x7f3e840c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e841e64f0 0x7f3e841e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8415e050 con 0x7f3e840c9340 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840d36b0 con 0x7f3e6c0051c0 2024-02-26T12:19:59.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.773+0000 7f3e8a3f0640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840cedd0 con 0x7f3e841e64f0 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58392/0 (socket says 172.21.15.113:58392) 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 -- 172.21.15.113:0/1725808572 learned_addr learned my addr 172.21.15.113:0/1725808572 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e837fe640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e841e64f0 0x7f3e841e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e83fff640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0051c0 0x7f3e840c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 -- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e841e64f0 msgr2=0x7f3e841e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e841e64f0 0x7f3e841e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 -- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0051c0 msgr2=0x7f3e840c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0051c0 0x7f3e840c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 -- 172.21.15.113:0/1725808572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840cba70 con 0x7f3e840c9340 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8898d640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c035d50 tx=0x7f3e7c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c003990 con 0x7f3e840c9340 2024-02-26T12:19:59.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c044070 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e840ca0a0 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c003d90 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.774+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e84147cc0 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.775+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e84074a50 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.776+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e7c005d10 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.776+0000 7f3e80ff9640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 0x7f3e7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.776+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e7c0ac580 con 0x7f3e840c9340 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.776+0000 7f3e83fff640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 0x7f3e7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.777+0000 7f3e83fff640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 0x7f3e7006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e74000fd0 tx=0x7f3e74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:19:59.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.781+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e840cba70 con 0x7f3e840c9340 2024-02-26T12:19:59.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:19:59.961+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3e840ce9e0 con 0x7f3e840c9340 2024-02-26T12:20:00.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.592+0000 7f3e80ff9640 1 -- 172.21.15.113:0/1725808572 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e7c07b820 con 0x7f3e840c9340 2024-02-26T12:20:00.577 INFO:teuthology.orchestra.run.smithi113.stderr: removed all blocklist entries 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 msgr2=0x7f3e7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 0x7f3e7006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e74000fd0 tx=0x7f3e74009040 comp rx=0 tx=0).stop 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 msgr2=0x7f3e840c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c035d50 tx=0x7f3e7c009750 comp rx=0 tx=0).stop 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 shutdown_connections 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e7006b4d0 0x7f3e7006d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e840c9340 0x7f3e840c97c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e841e64f0 0x7f3e841e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 --2- 172.21.15.113:0/1725808572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c0051c0 0x7f3e840c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 >> 172.21.15.113:0/1725808572 conn(0x7f3e840728b0 msgr2=0x7f3e840b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 shutdown_connections 2024-02-26T12:20:00.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.594+0000 7f3e8a3f0640 1 -- 172.21.15.113:0/1725808572 wait complete. 2024-02-26T12:20:00.592 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-02-26T12:20:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.710+0000 7f813e436640 1 Processor -- start 2024-02-26T12:20:00.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 -- start start 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f813815b340 0x7f81380711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8138071730 0x7f81380b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813806db50 con 0x7f8138154600 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813806e760 con 0x7f8138071730 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813e436640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8138071ba0 con 0x7f813815b340 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.711+0000 7f813c9d3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8138071730 0x7f81380b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f8137fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8138154600 0x7f813806d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57392/0 (socket says 172.21.15.113:57392) 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f8137fff640 1 -- 172.21.15.113:0/2522757794 learned_addr learned my addr 172.21.15.113:0/2522757794 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f81377fe640 1 --2- 172.21.15.113:0/2522757794 >> v2:172.21.15.152:3300/0 conn(0x7f813815b340 0x7f81380711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f813c9d3640 1 -- 172.21.15.113:0/2522757794 >> v2:172.21.15.152:3300/0 conn(0x7f813815b340 msgr2=0x7f81380711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f813c9d3640 1 --2- 172.21.15.113:0/2522757794 >> v2:172.21.15.152:3300/0 conn(0x7f813815b340 0x7f81380711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f813c9d3640 1 -- 172.21.15.113:0/2522757794 >> v1:172.21.15.113:6789/0 conn(0x7f8138154600 legacy=0x7f813806d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f813c9d3640 1 -- 172.21.15.113:0/2522757794 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813806de30 con 0x7f8138071730 2024-02-26T12:20:00.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.712+0000 7f8136ffd640 1 -- 172.21.15.113:0/2522757794 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307225734 0 0) 0x7f813806db50 con 0x7f8138154600 2024-02-26T12:20:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813c9d3640 1 --2- 172.21.15.113:0/2522757794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81380b2650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f813806ef50 tx=0x7f813002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42272dc92bebeca server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f8136ffd640 1 -- 172.21.15.113:0/2522757794 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130039070 con 0x7f8138071730 2024-02-26T12:20:00.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f8136ffd640 1 -- 172.21.15.113:0/2522757794 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813002cc80 con 0x7f8138071730 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f8136ffd640 1 -- 172.21.15.113:0/2522757794 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130034660 con 0x7f8138071730 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 -- 172.21.15.113:0/2522757794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 msgr2=0x7f81380b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 --2- 172.21.15.113:0/2522757794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81380b2650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f813806ef50 tx=0x7f813002bed0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 -- 172.21.15.113:0/2522757794 shutdown_connections 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 --2- 172.21.15.113:0/2522757794 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81380b2650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 --2- 172.21.15.113:0/2522757794 >> v2:172.21.15.152:3300/0 conn(0x7f813815b340 0x7f81380711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 -- 172.21.15.113:0/2522757794 >> 172.21.15.113:0/2522757794 conn(0x7f813806ab50 msgr2=0x7f813806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 -- 172.21.15.113:0/2522757794 shutdown_connections 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.713+0000 7f813e436640 1 -- 172.21.15.113:0/2522757794 wait complete. 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.714+0000 7f813e436640 1 Processor -- start 2024-02-26T12:20:00.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 -- start start 2024-02-26T12:20:00.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8138154600 0x7f8138151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f813815b340 0x7f8138154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381549e0 con 0x7f8138071730 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813806e3f0 con 0x7f8138154600 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f813e436640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8138154b60 con 0x7f813815b340 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f8137fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f8137fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58410/0 (socket says 172.21.15.113:58410) 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.715+0000 7f8137fff640 1 -- 172.21.15.113:0/2527430963 learned_addr learned my addr 172.21.15.113:0/2527430963 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f81377fe640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8138154600 0x7f8138151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f813c9d3640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f813815b340 0x7f8138154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 -- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f813815b340 msgr2=0x7f8138154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f813815b340 0x7f8138154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 -- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8138154600 msgr2=0x7f8138151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.703 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8138154600 0x7f8138151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 -- 172.21.15.113:0/2527430963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138151aa0 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8137fff640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c4d0 tx=0x7f812c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c018070 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c007500 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c004a20 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81380b0150 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.716+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380b0710 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.717+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8138074a50 con 0x7f8138071730 2024-02-26T12:20:00.704 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.718+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f812c01b070 con 0x7f8138071730 2024-02-26T12:20:00.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.718+0000 7f8134ff9640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 0x7f812406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:00.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.718+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f812c089130 con 0x7f8138071730 2024-02-26T12:20:00.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.718+0000 7f81377fe640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 0x7f812406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:00.705 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.718+0000 7f81377fe640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 0x7f812406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:00.707 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.722+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f812c058390 con 0x7f8138071730 2024-02-26T12:20:00.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.960+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8138072190 con 0x7f8138071730 2024-02-26T12:20:00.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.961+0000 7f8134ff9640 1 -- 172.21.15.113:0/2527430963 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f812c057c90 con 0x7f8138071730 2024-02-26T12:20:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:00.946 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: "auth_dump": [ 2024-02-26T12:20:00.946 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.a", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlIUVWBxAAoIb7CiZ0h4TnUId3z+lWYA==", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.b", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlBdyyExAAm7/XW6ucVqLy/GTXhq5aVA==", 2024-02-26T12:20:00.947 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.c", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlHEWwDhAACHSnTDGIW7ir19BlP6z9CQ==", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2024-02-26T12:20:00.948 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mds.d", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxl0/MOGxAAlLlajH3IYY+shV+XCK3slg==", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.0", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCRgdxlRx/nBBAAlWpF9a6IZHMlJsCirvPjhg==", 2024-02-26T12:20:00.949 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.1", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCUgdxl00S7AxAAw7vI8+KmK1XxgrM4KIS48Q==", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.950 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.2", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCXgdxlzlWVAhAAmWSHzmr7Mq6mOJuQ+bszNw==", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.3", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCagdxl9ikiARAAONErcGizNOuSv+AfEjlZ1Q==", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.951 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.4", 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCggdxlCwAyCRAAsQ4cnnXYVh1wIW/+PWunUQ==", 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.952 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.5", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCjgdxlTm0hCBAANHh2E/pki0/6nXks9fr9oA==", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.6", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCmgdxlFHy7BhAAJUNm7DiInx3+m9u7IVyK3A==", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.953 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "osd.7", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCpgdxlzsy0BBAAOh/fIEw/eIbxJl9pbLAd1g==", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow profile osd", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile osd", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.0", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlPw+IHxAAOkKN2ANdXBNLAJL0n0jDGw==", 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.1", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlLFCzKBAANfNh6C1RYTyf4vMEYWLdsQ==", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.2", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlvRhLJRAAY4uf22Sf4sVhx+wgfkfgpw==", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.3", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxlHOOALhAACszlhRajx7N0H/roUlBEMw==", 2024-02-26T12:20:00.956 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow r", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow rw", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow rwx" 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.admin", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCMgdxlE7HEJRAAljaPSlg+Uq9feUclzdIccw==", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mgr": "allow *", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow *", 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.957 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-mds", 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxljcidORAADfguZjhBBwSQBYKs2ht4Bg==", 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-mds" 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-mgr", 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxlK9CdORAA5SJugsCgaH4otW9B9gUGhw==", 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-mgr" 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.958 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-osd", 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxlsdadORAACLSLU21biOXwovEQWA4xIg==", 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-osd" 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rbd", 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxlJd2dORAAOslRPLh49PcZA92oaF8fzQ==", 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rbd" 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.959 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxlx+OdORAAH6y4Ra/GT8p3HMU74vhbeA==", 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "client.bootstrap-rgw", 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCugdxlseqdORAA3BaLEHkNfFFT3T3NAko53A==", 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile bootstrap-rgw" 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.960 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.x", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCNgdxl5u7qAxAADD0FSvDiWWwt6s9RwaDbow==", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "entity": "mgr.y", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "key": "AQCMgdxlwVdFOxAAN3iW1NzQNpMXBu1/VMunCQ==", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "caps": { 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "mds": "allow *", 2024-02-26T12:20:00.961 INFO:teuthology.orchestra.run.smithi113.stdout: "mon": "allow profile mgr", 2024-02-26T12:20:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: "osd": "allow *" 2024-02-26T12:20:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:00.962 INFO:teuthology.orchestra.run.smithi113.stdout: ] 2024-02-26T12:20:00.962 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:00.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 msgr2=0x7f812406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 0x7f812406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8128006fd0 tx=0x7f8128008040 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 msgr2=0x7f81381f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f812c00c4d0 tx=0x7f812c00c990 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 shutdown_connections 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f812406b4d0 0x7f812406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f813815b340 0x7f8138154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8138154600 0x7f8138151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 --2- 172.21.15.113:0/2527430963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8138071730 0x7f81381f35f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 >> 172.21.15.113:0/2527430963 conn(0x7f813806ab50 msgr2=0x7f81381533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 shutdown_connections 2024-02-26T12:20:00.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:00.963+0000 7f813e436640 1 -- 172.21.15.113:0/2527430963 wait complete. 2024-02-26T12:20:00.965 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-02-26T12:20:01.065 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.080+0000 7fbbfe76a640 1 Processor -- start 2024-02-26T12:20:01.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.080+0000 7fbbfe76a640 1 -- start start 2024-02-26T12:20:01.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbbf80cdaf0 0x7fbbf80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf806da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbbf806df90 0x7fbbf806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80cc6c0 con 0x7fbbf806df90 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80cfd00 con 0x7fbbf80cdaf0 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfe76a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80cc100 con 0x7fbbf80ca570 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfcd07640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbbf806df90 0x7fbbf806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfcd07640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbbf806df90 0x7fbbf806bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58414/0 (socket says 172.21.15.113:58414) 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbfcd07640 1 -- 172.21.15.113:0/914776351 learned_addr learned my addr 172.21.15.113:0/914776351 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbf77fe640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf806da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.081+0000 7fbbf7fff640 1 --2- 172.21.15.113:0/914776351 >> v2:172.21.15.152:3300/0 conn(0x7fbbf80cdaf0 0x7fbbf80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 -- 172.21.15.113:0/914776351 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 msgr2=0x7fbbf806da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf806da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 -- 172.21.15.113:0/914776351 >> v2:172.21.15.152:3300/0 conn(0x7fbbf80cdaf0 msgr2=0x7fbbf80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 --2- 172.21.15.113:0/914776351 >> v2:172.21.15.152:3300/0 conn(0x7fbbf80cdaf0 0x7fbbf80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.068 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 -- 172.21.15.113:0/914776351 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80cc3e0 con 0x7fbbf806df90 2024-02-26T12:20:01.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbfcd07640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf806bb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbf809df00 tx=0x7fbbf002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f598b11e216cb5 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbf6ffd640 1 -- 172.21.15.113:0/914776351 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf002c950 con 0x7fbbf806df90 2024-02-26T12:20:01.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbf6ffd640 1 -- 172.21.15.113:0/914776351 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf002caf0 con 0x7fbbf806df90 2024-02-26T12:20:01.069 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.082+0000 7fbbf6ffd640 1 -- 172.21.15.113:0/914776351 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00343f0 con 0x7fbbf806df90 2024-02-26T12:20:01.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 -- 172.21.15.113:0/914776351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 msgr2=0x7fbbf806bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf806bb70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbf809df00 tx=0x7fbbf002bdb0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 -- 172.21.15.113:0/914776351 shutdown_connections 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf806bb70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/914776351 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf806da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/914776351 >> v2:172.21.15.152:3300/0 conn(0x7fbbf80cdaf0 0x7fbbf80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 -- 172.21.15.113:0/914776351 >> 172.21.15.113:0/914776351 conn(0x7fbbf80cc9a0 msgr2=0x7fbbf80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 -- 172.21.15.113:0/914776351 shutdown_connections 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.083+0000 7fbbfe76a640 1 -- 172.21.15.113:0/914776351 wait complete. 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.084+0000 7fbbfe76a640 1 Processor -- start 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.084+0000 7fbbfe76a640 1 -- start start 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.072 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbf80cdaf0 0x7fbbf80c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf806c230 con 0x7fbbf806df90 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf806c0b0 con 0x7fbbf80cdaf0 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbfe76a640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf806c3b0 con 0x7fbbf80ca570 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58428/0 (socket says 172.21.15.113:58428) 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 -- 172.21.15.113:0/4128625712 learned_addr learned my addr 172.21.15.113:0/4128625712 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf77fe640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 -- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 msgr2=0x7fbbf815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf815d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 -- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbf80cdaf0 msgr2=0x7fbbf80c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbf80cdaf0 0x7fbbf80c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.085+0000 7fbbf7fff640 1 -- 172.21.15.113:0/4128625712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80c8ac0 con 0x7fbbf806df90 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbf7fff640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d800 tx=0x7fbbe800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800b6c0 con 0x7fbbf806df90 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8019070 con 0x7fbbf806df90 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80c8da0 con 0x7fbbf806df90 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800ba80 con 0x7fbbf806df90 2024-02-26T12:20:01.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.086+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80c9360 con 0x7fbbf806df90 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.087+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf8066e40 con 0x7fbbf806df90 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.087+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbbe800bc20 con 0x7fbbf806df90 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.088+0000 7fbbf4ff9640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 0x7fbbe406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.088+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbbe808a250 con 0x7fbbf806df90 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.088+0000 7fbbf77fe640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 0x7fbbe406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.088+0000 7fbbf77fe640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 0x7fbbe406d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbec006fd0 tx=0x7fbbec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.092+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbf8066e40 con 0x7fbbf806df90 2024-02-26T12:20:01.312 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.327+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbbf8074a50 con 0x7fbbf806df90 2024-02-26T12:20:01.314 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.329+0000 7fbbf4ff9640 1 -- 172.21.15.113:0/4128625712 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbbe805de20 con 0x7fbbf806df90 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 msgr2=0x7fbbe406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 0x7fbbe406d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbec006fd0 tx=0x7fbbec008040 comp rx=0 tx=0).stop 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 msgr2=0x7fbbf815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800d800 tx=0x7fbbe800dcc0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 shutdown_connections 2024-02-26T12:20:01.317 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbbe406b4d0 0x7fbbe406d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbbf80cdaf0 0x7fbbf80c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbbf80ca570 0x7fbbf815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 --2- 172.21.15.113:0/4128625712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbf806df90 0x7fbbf815a240 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 >> 172.21.15.113:0/4128625712 conn(0x7fbbf80cc9a0 msgr2=0x7fbbf806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 shutdown_connections 2024-02-26T12:20:01.318 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.332+0000 7fbbfe76a640 1 -- 172.21.15.113:0/4128625712 wait complete. 2024-02-26T12:20:01.328 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-02-26T12:20:01.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.444+0000 7fcb9c5fa640 1 Processor -- start 2024-02-26T12:20:01.430 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 -- start start 2024-02-26T12:20:01.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb940b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.433 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcb9406d2f0 0x7fcb940b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940ce1d0 con 0x7fcb9415aa60 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940cdf90 con 0x7fcb9406d2f0 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.445+0000 7fcb9c5fa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940ce4b0 con 0x7fcb9415ae40 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb9a396640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fcb9415aa60 0x7fcb940cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57404/0 (socket says 172.21.15.113:57404) 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb9a396640 1 -- 172.21.15.113:0/4003664463 learned_addr learned my addr 172.21.15.113:0/4003664463 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99b95640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb940b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832335967 0 0) 0x7fcb940ce1d0 con 0x7fcb9415aa60 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/4003664463 >> v2:172.21.15.152:3300/0 conn(0x7fcb9406d2f0 0x7fcb940b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb80003520 con 0x7fcb9415aa60 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771132598 0 0) 0x7fcb80003520 con 0x7fcb9415aa60 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 msgr2=0x7fcb940b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb940b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 >> v2:172.21.15.152:3300/0 conn(0x7fcb9406d2f0 msgr2=0x7fcb940b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.434 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 --2- 172.21.15.113:0/4003664463 >> v2:172.21.15.152:3300/0 conn(0x7fcb9406d2f0 0x7fcb940b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940ce790 con 0x7fcb9415aa60 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fcb90001a10 con 0x7fcb9415aa60 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 >> v1:172.21.15.113:6789/0 conn(0x7fcb9415aa60 legacy=0x7fcb940cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb800039b0 0x7fcb80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940cdf90 con 0x7fcb800039b0 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940ce4b0 con 0x7fcb80004d40 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000b9c0 con 0x7fcb9415ae40 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb9a396640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb800039b0 0x7fcb80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.446+0000 7fcb99b95640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 -- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 msgr2=0x7fcb80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.435 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 -- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb80004d40 msgr2=0x7fcb800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 -- 172.21.15.113:0/4003664463 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80003520 con 0x7fcb800039b0 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb99b95640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb9415ae40 0x7fcb80004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb80004d40 0x7fcb800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb9a396640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb800039b0 0x7fcb80003dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000a870 tx=0x7fcb80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ba02d5553a7a6b server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000a4c0 con 0x7fcb800039b0 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90034650 con 0x7fcb800039b0 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.447+0000 7fcb99394640 1 -- 172.21.15.113:0/4003664463 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90034a40 con 0x7fcb800039b0 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/4003664463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb800039b0 msgr2=0x7fcb80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/4003664463 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb800039b0 0x7fcb80003dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000a870 tx=0x7fcb80005830 comp rx=0 tx=0).stop 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9ab97640 1 -- 172.21.15.113:0/4003664463 reap_dead start 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/4003664463 shutdown_connections 2024-02-26T12:20:01.436 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/4003664463 >> 172.21.15.113:0/4003664463 conn(0x7fcb9406ab50 msgr2=0x7fcb9406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:01.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/4003664463 shutdown_connections 2024-02-26T12:20:01.437 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.448+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/4003664463 wait complete. 2024-02-26T12:20:01.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.449+0000 7fcb9c5fa640 1 Processor -- start 2024-02-26T12:20:01.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.449+0000 7fcb9c5fa640 1 -- start start 2024-02-26T12:20:01.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb800039b0 0x7fcb941ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb9414d900 0x7fcb9414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b4180 con 0x7fcb9414dd60 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940ced50 con 0x7fcb9414d900 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9c5fa640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b4300 con 0x7fcb800039b0 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58444/0 (socket says 172.21.15.113:58444) 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 -- 172.21.15.113:0/2655755309 learned_addr learned my addr 172.21.15.113:0/2655755309 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb99b95640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb9414d900 0x7fcb9414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9a396640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb800039b0 0x7fcb941ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 -- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb800039b0 msgr2=0x7fcb941ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb800039b0 0x7fcb941ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 -- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb9414d900 msgr2=0x7fcb9414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.441 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb9414d900 0x7fcb9414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.450+0000 7fcb9ab97640 1 -- 172.21.15.113:0/2655755309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94150880 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb9ab97640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406bb20 tx=0x7fcb8c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c004440 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c01b070 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94150b60 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c003850 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.451+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94151120 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.452+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94074a50 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.452+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcb8c0039f0 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.452+0000 7fcb8affd640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 0x7fcb7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.453+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb8c08a060 con 0x7fcb9414dd60 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.453+0000 7fcb9a396640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 0x7fcb7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.442 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.453+0000 7fcb9a396640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 0x7fcb7806d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb90034000 tx=0x7fcb90009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.443 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.457+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcb8c0591a0 con 0x7fcb9414dd60 2024-02-26T12:20:01.683 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.697+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcb941efbd0 con 0x7fcb9414dd60 2024-02-26T12:20:01.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.702+0000 7fcb8affd640 1 -- 172.21.15.113:0/2655755309 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcb8c058aa0 con 0x7fcb9414dd60 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 msgr2=0x7fcb7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 0x7fcb7806d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb90034000 tx=0x7fcb90009030 comp rx=0 tx=0).stop 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 msgr2=0x7fcb9414feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406bb20 tx=0x7fcb8c011920 comp rx=0 tx=0).stop 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 shutdown_connections 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fcb7806b500 0x7fcb7806d9c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb9414dd60 0x7fcb9414feb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb9414d900 0x7fcb9414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.703+0000 7fcb9c5fa640 1 --2- 172.21.15.113:0/2655755309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb800039b0 0x7fcb941ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.704+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 >> 172.21.15.113:0/2655755309 conn(0x7fcb9406ab50 msgr2=0x7fcb94154360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:01.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.704+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 shutdown_connections 2024-02-26T12:20:01.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.704+0000 7fcb9c5fa640 1 -- 172.21.15.113:0/2655755309 wait complete. 2024-02-26T12:20:01.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-02-26T12:20:01.800 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.815+0000 7fc920508640 1 Processor -- start 2024-02-26T12:20:01.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.815+0000 7fc920508640 1 -- start start 2024-02-26T12:20:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc920508640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc91815ae40 0x7fc9180b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc920508640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc920508640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180ce1d0 con 0x7fc91815aa60 2024-02-26T12:20:01.802 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc920508640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180cdf90 con 0x7fc91815ae40 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc920508640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180ce4b0 con 0x7fc91806d2f0 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc91815ae40 0x7fc9180b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc91815ae40 0x7fc9180b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58448/0 (socket says 172.21.15.113:58448) 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 -- 172.21.15.113:0/4218613105 learned_addr learned my addr 172.21.15.113:0/4218613105 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91eaa5640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 -- 172.21.15.113:0/4218613105 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 msgr2=0x7fc9180b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 -- 172.21.15.113:0/4218613105 >> v1:172.21.15.152:6789/0 conn(0x7fc91815aa60 legacy=0x7fc9180cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.816+0000 7fc91daa3640 1 -- 172.21.15.113:0/4218613105 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180ce790 con 0x7fc91815ae40 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.817+0000 7fc91daa3640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815ae40 0x7fc9180b4180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc908009870 tx=0x7fc90802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dd75e431596e96 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.817+0000 7fc91d2a2640 1 -- 172.21.15.113:0/4218613105 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908035020 con 0x7fc91815ae40 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.817+0000 7fc91d2a2640 1 -- 172.21.15.113:0/4218613105 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908031640 con 0x7fc91815ae40 2024-02-26T12:20:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.817+0000 7fc91d2a2640 1 -- 172.21.15.113:0/4218613105 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90802d040 con 0x7fc91815ae40 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 -- 172.21.15.113:0/4218613105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815ae40 msgr2=0x7fc9180b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815ae40 0x7fc9180b4180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc908009870 tx=0x7fc90802b8f0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 -- 172.21.15.113:0/4218613105 shutdown_connections 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 --2- 172.21.15.113:0/4218613105 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815ae40 0x7fc9180b4180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 -- 172.21.15.113:0/4218613105 >> 172.21.15.113:0/4218613105 conn(0x7fc91806ab50 msgr2=0x7fc91806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 -- 172.21.15.113:0/4218613105 shutdown_connections 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.818+0000 7fc920508640 1 -- 172.21.15.113:0/4218613105 wait complete. 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.819+0000 7fc920508640 1 Processor -- start 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.819+0000 7fc920508640 1 -- start start 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc91815ae40 0x7fc918144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cf270 con 0x7fc91815aa60 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180ced50 con 0x7fc91815ae40 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180cf3f0 con 0x7fc91806d2f0 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58452/0 (socket says 172.21.15.113:58452) 2024-02-26T12:20:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 -- 172.21.15.113:0/853180770 learned_addr learned my addr 172.21.15.113:0/853180770 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91eaa5640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc91815ae40 0x7fc918144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91e2a4640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 -- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 msgr2=0x7fc9180a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 -- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc91815ae40 msgr2=0x7fc918144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc91815ae40 0x7fc918144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 -- 172.21.15.113:0/853180770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180a89e0 con 0x7fc91815aa60 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91e2a4640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc91daa3640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc90802b930 tx=0x7fc9080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908040070 con 0x7fc91815aa60 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9080399f0 con 0x7fc91815aa60 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908035040 con 0x7fc91815aa60 2024-02-26T12:20:01.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.820+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9181e3f60 con 0x7fc91815aa60 2024-02-26T12:20:01.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.821+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9181e4520 con 0x7fc91815aa60 2024-02-26T12:20:01.809 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.821+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc918074a50 con 0x7fc91815aa60 2024-02-26T12:20:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.822+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc90804b060 con 0x7fc91815aa60 2024-02-26T12:20:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.822+0000 7fc90effd640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 0x7fc8fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.822+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc9080ab820 con 0x7fc91815aa60 2024-02-26T12:20:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.822+0000 7fc91e2a4640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 0x7fc8fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.823+0000 7fc91e2a4640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 0x7fc8fc06d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc914004520 tx=0x7fc914009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:01.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:01.826+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc90807aa00 con 0x7fc91815aa60 2024-02-26T12:20:02.048 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.063+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc91806b040 con 0x7fc91815aa60 2024-02-26T12:20:02.051 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.067+0000 7fc90effd640 1 -- 172.21.15.113:0/853180770 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc90807a300 con 0x7fc91815aa60 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 msgr2=0x7fc8fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 0x7fc8fc06d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc914004520 tx=0x7fc914009040 comp rx=0 tx=0).stop 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 msgr2=0x7fc9180ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc90802b930 tx=0x7fc9080046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 shutdown_connections 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc8fc06b4d0 0x7fc8fc06d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.054 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc91815ae40 0x7fc918144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc91815aa60 0x7fc9180ae490 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 --2- 172.21.15.113:0/853180770 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc91806d2f0 0x7fc9180a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.068+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 >> 172.21.15.113:0/853180770 conn(0x7fc91806ab50 msgr2=0x7fc9180cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.069+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 shutdown_connections 2024-02-26T12:20:02.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.069+0000 7fc920508640 1 -- 172.21.15.113:0/853180770 wait complete. 2024-02-26T12:20:02.064 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-02-26T12:20:02.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.181+0000 7f46f6f1e640 1 Processor -- start 2024-02-26T12:20:02.166 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.181+0000 7f46f6f1e640 1 -- start start 2024-02-26T12:20:02.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.181+0000 7f46f6f1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f46f015aa60 0x7f46f00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.168 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.181+0000 7f46f6f1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f00b4890 0x7f46f00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f6f1e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f00ce1d0 con 0x7f46f015ae40 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f6f1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f00ce4b0 con 0x7f46f015aa60 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f6f1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00ce790 con 0x7f46f00b4890 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f46f015aa60 0x7f46f00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46effff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f46f015ae40 0x7f46f00b4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57418/0 (socket says 172.21.15.113:57418) 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f46f015aa60 0x7f46f00cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58464/0 (socket says 172.21.15.113:58464) 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 -- 172.21.15.113:0/3358868241 learned_addr learned my addr 172.21.15.113:0/3358868241 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f54bb640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f00b4890 0x7f46f00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 -- 172.21.15.113:0/3358868241 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f00b4890 msgr2=0x7f46f00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f00b4890 0x7f46f00cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 -- 172.21.15.113:0/3358868241 >> v1:172.21.15.113:6789/0 conn(0x7f46f015ae40 legacy=0x7f46f00b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46f4cba640 1 -- 172.21.15.113:0/3358868241 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f00cea70 con 0x7f46f015aa60 2024-02-26T12:20:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.182+0000 7f46ef7fe640 1 -- 172.21.15.113:0/3358868241 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607404822 0 0) 0x7f46f00ce1d0 con 0x7f46f015ae40 2024-02-26T12:20:02.170 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f4cba640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f015aa60 0x7f46f00cd880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46e400bb10 tx=0x7f46e402e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84645eb7a17d9ae3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46ef7fe640 1 -- 172.21.15.113:0/3358868241 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e403b070 con 0x7f46f015aa60 2024-02-26T12:20:02.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46ef7fe640 1 -- 172.21.15.113:0/3358868241 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e4036440 con 0x7f46f015aa60 2024-02-26T12:20:02.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46ef7fe640 1 -- 172.21.15.113:0/3358868241 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4036810 con 0x7f46f015aa60 2024-02-26T12:20:02.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 -- 172.21.15.113:0/3358868241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f015aa60 msgr2=0x7f46f00cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f015aa60 0x7f46f00cd880 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f46e400bb10 tx=0x7f46e402e150 comp rx=0 tx=0).stop 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 -- 172.21.15.113:0/3358868241 shutdown_connections 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f00b4890 0x7f46f00cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/3358868241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f015aa60 0x7f46f00cd880 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 -- 172.21.15.113:0/3358868241 >> 172.21.15.113:0/3358868241 conn(0x7f46f006ab50 msgr2=0x7f46f006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 -- 172.21.15.113:0/3358868241 shutdown_connections 2024-02-26T12:20:02.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.183+0000 7f46f6f1e640 1 -- 172.21.15.113:0/3358868241 wait complete. 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 Processor -- start 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 -- start start 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f015aa60 0x7f46f00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46f015ae40 0x7f46f0149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00cdf40 con 0x7f46f00b4890 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f00cddc0 con 0x7f46f015ae40 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.185+0000 7f46f6f1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f006d2f0 con 0x7f46f015aa60 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58470/0 (socket says 172.21.15.113:58470) 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 -- 172.21.15.113:0/2924409658 learned_addr learned my addr 172.21.15.113:0/2924409658 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 -- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f015aa60 msgr2=0x7f46f00cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.175 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f015aa60 0x7f46f00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 -- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46f015ae40 msgr2=0x7f46f0149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46f015ae40 0x7f46f0149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 -- 172.21.15.113:0/2924409658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f01499b0 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f4cba640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b2c0 tx=0x7f46e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e4045020 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e40346c0 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f0146e90 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e403b040 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.186+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f0147450 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.187+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f0074a50 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.188+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f46e4048020 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.188+0000 7f46ed7fa640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 0x7f46d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.188+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f46e40ae8b0 con 0x7f46f00b4890 2024-02-26T12:20:02.176 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.188+0000 7f46effff640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 0x7f46d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.188+0000 7f46effff640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 0x7f46d406d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46dc007fd0 tx=0x7f46dc007960 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.177 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.192+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46e404f030 con 0x7f46f00b4890 2024-02-26T12:20:02.419 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.434+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f46f00cc180 con 0x7f46f00b4890 2024-02-26T12:20:02.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.438+0000 7f46ed7fa640 1 -- 172.21.15.113:0/2924409658 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f46f01499b0 con 0x7f46f00b4890 2024-02-26T12:20:02.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 msgr2=0x7f46d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.425 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 0x7f46d406d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46dc007fd0 tx=0x7f46dc007960 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 msgr2=0x7f46f0149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f46e400b2c0 tx=0x7f46e40046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 shutdown_connections 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f46d406b4d0 0x7f46d406d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46f015ae40 0x7f46f0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f46f015aa60 0x7f46f00cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 --2- 172.21.15.113:0/2924409658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f46f00b4890 0x7f46f0149470 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 >> 172.21.15.113:0/2924409658 conn(0x7f46f006ab50 msgr2=0x7f46f0159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 shutdown_connections 2024-02-26T12:20:02.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.440+0000 7f46f6f1e640 1 -- 172.21.15.113:0/2924409658 wait complete. 2024-02-26T12:20:02.436 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-02-26T12:20:02.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.551+0000 7f2340bed640 1 Processor -- start 2024-02-26T12:20:02.536 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.551+0000 7f2340bed640 1 -- start start 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f2340bed640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f233c15ae40 0x7f233c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f2340bed640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0ce1d0 con 0x7f233c15aa60 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f2340bed640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0ce4b0 con 0x7f233c06d2f0 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f2340bed640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0cdf90 con 0x7f233c15ae40 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f233a59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f233c15aa60 0x7f233c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57428/0 (socket says 172.21.15.113:57428) 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f233a59c640 1 -- 172.21.15.113:0/4082291467 learned_addr learned my addr 172.21.15.113:0/4082291467 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f2339d9b640 1 --2- 172.21.15.113:0/4082291467 >> v2:172.21.15.152:3300/0 conn(0x7f233c15ae40 0x7f233c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005510640 0 0) 0x7f233c0ce1d0 con 0x7f233c15aa60 2024-02-26T12:20:02.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.552+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324005730 con 0x7f233c15aa60 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619130015 0 0) 0x7f2324005730 con 0x7f233c15aa60 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 >> v2:172.21.15.152:3300/0 conn(0x7f233c15ae40 msgr2=0x7f233c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 --2- 172.21.15.113:0/4082291467 >> v2:172.21.15.152:3300/0 conn(0x7f233c15ae40 0x7f233c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 >> v1:172.21.15.152:6789/0 conn(0x7f233c06d2f0 legacy=0x7f233c0cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0ce790 con 0x7f233c15aa60 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f232c0019f0 con 0x7f233c15aa60 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 >> v1:172.21.15.113:6789/0 conn(0x7f233c15aa60 legacy=0x7f233c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 0x7f2324005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2324006a10 0x7f2324006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23240073d0 0x7f232400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0cdf90 con 0x7f2324005bc0 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232400e270 con 0x7f23240073d0 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232400e470 con 0x7f2324006a10 2024-02-26T12:20:02.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 0x7f2324005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f2339d9b640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2324006a10 0x7f2324006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233ad9d640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23240073d0 0x7f232400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 -- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2324006a10 msgr2=0x7f2324006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2324006a10 0x7f2324006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 -- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23240073d0 msgr2=0x7f232400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23240073d0 0x7f232400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233a59c640 1 -- 172.21.15.113:0/4082291467 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324005730 con 0x7f2324005bc0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f2339d9b640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2324006a10 0x7f2324006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233ad9d640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23240073d0 0x7f232400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.553+0000 7f233ad9d640 1 -- 172.21.15.113:0/4082291467 reap_dead start 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f233a59c640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 0x7f2324005fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a840 tx=0x7f2324007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63aece77443041e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00a460 con 0x7f2324005bc0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c034650 con 0x7f2324005bc0 2024-02-26T12:20:02.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f233959a640 1 -- 172.21.15.113:0/4082291467 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c034a40 con 0x7f2324005bc0 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f2340bed640 1 -- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 msgr2=0x7f2324005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f2340bed640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 0x7f2324005fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a840 tx=0x7f2324007a40 comp rx=0 tx=0).stop 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f2340bed640 1 -- 172.21.15.113:0/4082291467 shutdown_connections 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f2340bed640 1 --2- 172.21.15.113:0/4082291467 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2324005bc0 0x7f2324005fe0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.554+0000 7f2340bed640 1 -- 172.21.15.113:0/4082291467 >> 172.21.15.113:0/4082291467 conn(0x7f233c06ab50 msgr2=0x7f233c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.555+0000 7f2340bed640 1 -- 172.21.15.113:0/4082291467 shutdown_connections 2024-02-26T12:20:02.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.555+0000 7f2340bed640 1 -- 172.21.15.113:0/4082291467 wait complete. 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.556+0000 7f2340bed640 1 Processor -- start 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.556+0000 7f2340bed640 1 -- start start 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324005bc0 0x7f233c14bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f233c1553c0 0x7f233c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0cd880 con 0x7f233c14e280 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0ced50 con 0x7f2324005bc0 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c0cda00 con 0x7f233c1553c0 2024-02-26T12:20:02.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58492/0 (socket says 172.21.15.113:58492) 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 -- 172.21.15.113:0/1418597146 learned_addr learned my addr 172.21.15.113:0/1418597146 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2339d9b640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f233c1553c0 0x7f233c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233a59c640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324005bc0 0x7f233c14bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 -- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f233c1553c0 msgr2=0x7f233c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f233c1553c0 0x7f233c155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 -- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324005bc0 msgr2=0x7f233c14bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324005bc0 0x7f233c14bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 -- 172.21.15.113:0/1418597146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c1525b0 con 0x7f233c14e280 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f233ad9d640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f233c06f770 tx=0x7f233400e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334019070 con 0x7f233c14e280 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340050d0 con 0x7f233c14e280 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340035f0 con 0x7f233c14e280 2024-02-26T12:20:02.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c152850 con 0x7f233c14e280 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.557+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c152e10 con 0x7f233c14e280 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.558+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c074a50 con 0x7f233c14e280 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.559+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f233401c070 con 0x7f233c14e280 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.559+0000 7f232affd640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 0x7f231c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.559+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23340892c0 con 0x7f233c14e280 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.559+0000 7f233a59c640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 0x7f231c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.560+0000 7f233a59c640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 0x7f231c06d9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f232c034000 tx=0x7f232c009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.563+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2334057ed0 con 0x7f233c14e280 2024-02-26T12:20:02.788 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.803+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f233c071bc0 con 0x7f233c14e280 2024-02-26T12:20:02.791 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.806+0000 7f232affd640 1 -- 172.21.15.113:0/1418597146 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f233405bf70 con 0x7f233c14e280 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 msgr2=0x7f231c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 0x7f231c06d9c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f232c034000 tx=0x7f232c009030 comp rx=0 tx=0).stop 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 msgr2=0x7f233c14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f233c06f770 tx=0x7f233400e5f0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 shutdown_connections 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f231c06b500 0x7f231c06d9c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.794 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f233c14e280 0x7f233c14e700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f233c1553c0 0x7f233c155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 --2- 172.21.15.113:0/1418597146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2324005bc0 0x7f233c14bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 >> 172.21.15.113:0/1418597146 conn(0x7f233c06ab50 msgr2=0x7f233c0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 shutdown_connections 2024-02-26T12:20:02.795 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.809+0000 7f2340bed640 1 -- 172.21.15.113:0/1418597146 wait complete. 2024-02-26T12:20:02.805 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-02-26T12:20:02.905 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.920+0000 7fa9b8fb4640 1 Processor -- start 2024-02-26T12:20:02.906 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.920+0000 7fa9b8fb4640 1 -- start start 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b8fb4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b409a150 0x7fa9b406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b8fb4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa9b40cfc10 0x7fa9b415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b8fb4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b40d00c0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b8fb4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b406c1c0 con 0x7fa9b40cfc10 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b8fb4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40d0f50 con 0x7fa9b409a150 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b2d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa9b40cfc10 0x7fa9b415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b2d9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa9b40cfc10 0x7fa9b415d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58494/0 (socket says 172.21.15.113:58494) 2024-02-26T12:20:02.907 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.921+0000 7fa9b2d9d640 1 -- 172.21.15.113:0/1437194433 learned_addr learned my addr 172.21.15.113:0/1437194433 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:02.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b1d9b640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b409a150 0x7fa9b406cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b2d9d640 1 -- 172.21.15.113:0/1437194433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b409a150 msgr2=0x7fa9b406cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b2d9d640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b409a150 0x7fa9b406cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b2d9d640 1 -- 172.21.15.113:0/1437194433 >> v1:172.21.15.152:6789/0 conn(0x7fa9b40b2c20 legacy=0x7fa9b4099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:02.908 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b2d9d640 1 -- 172.21.15.113:0/1437194433 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40d0340 con 0x7fa9b40cfc10 2024-02-26T12:20:02.909 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.922+0000 7fa9b2d9d640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40cfc10 0x7fa9b415d510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a788c7eaebd9c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b159a640 1 -- 172.21.15.113:0/1437194433 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac035020 con 0x7fa9b40cfc10 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b159a640 1 -- 172.21.15.113:0/1437194433 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac031640 con 0x7fa9b40cfc10 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b159a640 1 -- 172.21.15.113:0/1437194433 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac02d040 con 0x7fa9b40cfc10 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/1437194433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40cfc10 msgr2=0x7fa9b415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40cfc10 0x7fa9b415d510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac02b8f0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/1437194433 shutdown_connections 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40cfc10 0x7fa9b415d510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/1437194433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b409a150 0x7fa9b406cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/1437194433 >> 172.21.15.113:0/1437194433 conn(0x7fa9b40b3390 msgr2=0x7fa9b40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/1437194433 shutdown_connections 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.923+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/1437194433 wait complete. 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 Processor -- start 2024-02-26T12:20:02.910 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 -- start start 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 0x7fa9b40c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 0x7fa9b415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40d0be0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40d0900 con 0x7fa9b409a150 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b8fb4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40d13e0 con 0x7fa9b40cfc10 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b1d9b640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58506/0 (socket says 172.21.15.113:58506) 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b1d9b640 1 -- 172.21.15.113:0/579376628 learned_addr learned my addr 172.21.15.113:0/579376628 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b2d9d640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 0x7fa9b415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.914 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.925+0000 7fa9b259c640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 0x7fa9b40c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 -- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 msgr2=0x7fa9b415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 0x7fa9b415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 -- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 msgr2=0x7fa9b40c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 0x7fa9b40c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 -- 172.21.15.113:0/579376628 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40c6fd0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b259c640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 0x7fa9b40c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b2d9d640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 0x7fa9b415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b1d9b640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d800 tx=0x7fa9a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800b6c0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8019070 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b40c72b0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800ba80 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.926+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b40c7870 con 0x7fa9b40b2c20 2024-02-26T12:20:02.915 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.927+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b406ddf0 con 0x7fa9b40b2c20 2024-02-26T12:20:02.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.927+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9a800bc20 con 0x7fa9b40b2c20 2024-02-26T12:20:02.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.928+0000 7fa9a2ffd640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:02.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.928+0000 7fa9b259c640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:02.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.928+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9a808a390 con 0x7fa9b40b2c20 2024-02-26T12:20:02.916 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.928+0000 7fa9b259c640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 0x7fa99406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40045b0 tx=0x7fa9a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:02.917 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:02.932+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9a8059560 con 0x7fa9b40b2c20 2024-02-26T12:20:03.153 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.168+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa9b40b72b0 con 0x7fa9b40b2c20 2024-02-26T12:20:03.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.171+0000 7fa9a2ffd640 1 -- 172.21.15.113:0/579376628 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa9a8058e60 con 0x7fa9b40b2c20 2024-02-26T12:20:03.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 msgr2=0x7fa99406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 0x7fa99406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40045b0 tx=0x7fa9a4009040 comp rx=0 tx=0).stop 2024-02-26T12:20:03.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 msgr2=0x7fa9b415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d800 tx=0x7fa9a800dcc0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 shutdown_connections 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9b40cfc10 0x7fa9b415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa9b40b2c20 0x7fa9b415c410 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 --2- 172.21.15.113:0/579376628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9b409a150 0x7fa9b40c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 >> 172.21.15.113:0/579376628 conn(0x7fa9b40b3390 msgr2=0x7fa9b406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 shutdown_connections 2024-02-26T12:20:03.160 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.174+0000 7fa9b8fb4640 1 -- 172.21.15.113:0/579376628 wait complete. 2024-02-26T12:20:03.170 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:03.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.285+0000 7f0d864de640 1 Processor -- start 2024-02-26T12:20:03.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.285+0000 7f0d864de640 1 -- start start 2024-02-26T12:20:03.272 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d864de640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d8006d250 0x7f0d8015e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d864de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8015bf80 0x7f0d8015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d864de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8015eb60 con 0x7f0d800aed50 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d864de640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800af130 con 0x7f0d8006d250 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d864de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015ee40 con 0x7f0d8015bf80 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d7f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d8006d250 0x7f0d8015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d7f7fe640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d8006d250 0x7f0d8015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58514/0 (socket says 172.21.15.113:58514) 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/3221698736 learned_addr learned my addr 172.21.15.113:0/3221698736 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.286+0000 7f0d84a7b640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8015bf80 0x7f0d8015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/3221698736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8015bf80 msgr2=0x7f0d8015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7f7fe640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8015bf80 0x7f0d8015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/3221698736 >> v1:172.21.15.152:6789/0 conn(0x7f0d800aed50 legacy=0x7f0d800b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/3221698736 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8015f120 con 0x7f0d8006d250 2024-02-26T12:20:03.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7f7fe640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d8006d250 0x7f0d8015e460 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0d8006f500 tx=0x7f0d7402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ae297dcb9436e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.287+0000 7f0d7effd640 1 -- 172.21.15.113:0/3221698736 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7403b070 con 0x7f0d8006d250 2024-02-26T12:20:03.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d7effd640 1 -- 172.21.15.113:0/3221698736 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7402ee50 con 0x7f0d8006d250 2024-02-26T12:20:03.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d7effd640 1 -- 172.21.15.113:0/3221698736 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74036660 con 0x7f0d8006d250 2024-02-26T12:20:03.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 -- 172.21.15.113:0/3221698736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d8006d250 msgr2=0x7f0d8015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d8006d250 0x7f0d8015e460 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0d8006f500 tx=0x7f0d7402e0a0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 -- 172.21.15.113:0/3221698736 shutdown_connections 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8015bf80 0x7f0d8015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 --2- 172.21.15.113:0/3221698736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d8006d250 0x7f0d8015e460 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 -- 172.21.15.113:0/3221698736 >> 172.21.15.113:0/3221698736 conn(0x7f0d8006ab50 msgr2=0x7f0d8006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 -- 172.21.15.113:0/3221698736 shutdown_connections 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.288+0000 7f0d864de640 1 -- 172.21.15.113:0/3221698736 wait complete. 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.289+0000 7f0d864de640 1 Processor -- start 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.289+0000 7f0d864de640 1 -- start start 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8006d250 0x7f0d80149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d8015bf80 0x7f0d800adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b4050 con 0x7f0d800aed50 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b3420 con 0x7f0d8015bf80 2024-02-26T12:20:03.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d864de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800b41d0 con 0x7f0d8006d250 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58524/0 (socket says 172.21.15.113:58524) 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/207299734 learned_addr learned my addr 172.21.15.113:0/207299734 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d84a7b640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d8015bf80 0x7f0d800adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7ffff640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8006d250 0x7f0d80149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8006d250 msgr2=0x7f0d80149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8006d250 0x7f0d80149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d8015bf80 msgr2=0x7f0d800adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d8015bf80 0x7f0d800adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.290+0000 7f0d7f7fe640 1 -- 172.21.15.113:0/207299734 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800aca50 con 0x7f0d800aed50 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d7f7fe640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b2c0 tx=0x7f0d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74046070 con 0x7f0d800aed50 2024-02-26T12:20:03.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7403f550 con 0x7f0d800aed50 2024-02-26T12:20:03.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d800acd30 con 0x7f0d800aed50 2024-02-26T12:20:03.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7403b070 con 0x7f0d800aed50 2024-02-26T12:20:03.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.291+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d800ad2f0 con 0x7f0d800aed50 2024-02-26T12:20:03.279 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.292+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80074a50 con 0x7f0d800aed50 2024-02-26T12:20:03.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.292+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d74049070 con 0x7f0d800aed50 2024-02-26T12:20:03.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.293+0000 7f0d7cff9640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 0x7f0d6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.293+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d740abc70 con 0x7f0d800aed50 2024-02-26T12:20:03.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.293+0000 7f0d7ffff640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 0x7f0d6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.280 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.293+0000 7f0d7ffff640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 0x7f0d6c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d70004ea0 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.282 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.297+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d7407ae40 con 0x7f0d800aed50 2024-02-26T12:20:03.453 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.468+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d8006e3f0 con 0x7f0d800aed50 2024-02-26T12:20:03.454 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.469+0000 7f0d7cff9640 1 -- 172.21.15.113:0/207299734 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12915 (secure 0 0 0) 0x7f0d7407a740 con 0x7f0d800aed50 2024-02-26T12:20:03.454 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:03.454 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":27,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:00.598404+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 msgr2=0x7f0d6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 0x7f0d6c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d70004ea0 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 msgr2=0x7f0d801e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b2c0 tx=0x7f0d74004730 comp rx=0 tx=0).stop 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 shutdown_connections 2024-02-26T12:20:03.456 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d6c06b4d0 0x7f0d6c06d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d8015bf80 0x7f0d800adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d800aed50 0x7f0d801e69a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 --2- 172.21.15.113:0/207299734 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d8006d250 0x7f0d80149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 >> 172.21.15.113:0/207299734 conn(0x7f0d8006ab50 msgr2=0x7f0d800b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 shutdown_connections 2024-02-26T12:20:03.457 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.471+0000 7f0d864de640 1 -- 172.21.15.113:0/207299734 wait complete. 2024-02-26T12:20:03.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:20:03.467 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:20:03.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.586+0000 7f97f8374640 1 Processor -- start 2024-02-26T12:20:03.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.586+0000 7f97f8374640 1 -- start start 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f8374640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f97f015de30 0x7f97f00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f8374640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97f00d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f8374640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00d1dc0 con 0x7f97f00b5b50 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f8374640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f0161d50 con 0x7f97f015de30 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f8374640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cf000 con 0x7f97f00ceb00 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f590f640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f97f00b5b50 0x7f97f00ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57444/0 (socket says 172.21.15.113:57444) 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.587+0000 7f97f590f640 1 -- 172.21.15.113:0/1068223428 learned_addr learned my addr 172.21.15.113:0/1068223428 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501527672 0 0) 0x7f97f00d1dc0 con 0x7f97f00b5b50 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc003520 con 0x7f97f00b5b50 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f6110640 1 --2- 172.21.15.113:0/1068223428 >> v2:172.21.15.152:3300/0 conn(0x7f97f015de30 0x7f97f00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.576 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f6911640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97f00d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3550729263 0 0) 0x7f97dc003520 con 0x7f97f00b5b50 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 msgr2=0x7f97f00d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97f00d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 >> v2:172.21.15.152:3300/0 conn(0x7f97f015de30 msgr2=0x7f97f00b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 --2- 172.21.15.113:0/1068223428 >> v2:172.21.15.152:3300/0 conn(0x7f97f015de30 0x7f97f00b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00d2060 con 0x7f97f00b5b50 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f97e0001670 con 0x7f97f00b5b50 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 >> v1:172.21.15.113:6789/0 conn(0x7f97f00b5b50 legacy=0x7f97f00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc0039b0 0x7f97dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97dc004800 0x7f97dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0161d50 con 0x7f97dc004800 2024-02-26T12:20:03.577 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cf000 con 0x7f97dc0039b0 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc00ba70 con 0x7f97f00ceb00 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97dc004800 0x7f97dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f6110640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc0039b0 0x7f97dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f6911640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 -- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 msgr2=0x7f97dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ceb00 0x7f97dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 -- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc0039b0 msgr2=0x7f97dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc0039b0 0x7f97dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.588+0000 7f97f590f640 1 -- 172.21.15.113:0/1068223428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc003520 con 0x7f97dc004800 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.589+0000 7f97f590f640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97dc004800 0x7f97dc004c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97e0001eb0 tx=0x7f97dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898384cf8cfceb14 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.589+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0007d70 con 0x7f97dc004800 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.589+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0030070 con 0x7f97dc004800 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.589+0000 7f97f510e640 1 -- 172.21.15.113:0/1068223428 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0005d30 con 0x7f97dc004800 2024-02-26T12:20:03.578 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 -- 172.21.15.113:0/1068223428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97dc004800 msgr2=0x7f97dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 --2- 172.21.15.113:0/1068223428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97dc004800 0x7f97dc004c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97e0001eb0 tx=0x7f97dc005830 comp rx=0 tx=0).stop 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f6911640 1 -- 172.21.15.113:0/1068223428 reap_dead start 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 -- 172.21.15.113:0/1068223428 shutdown_connections 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 -- 172.21.15.113:0/1068223428 >> 172.21.15.113:0/1068223428 conn(0x7f97f00d0610 msgr2=0x7f97f00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 -- 172.21.15.113:0/1068223428 shutdown_connections 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.590+0000 7f97f8374640 1 -- 172.21.15.113:0/1068223428 wait complete. 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.591+0000 7f97f8374640 1 Processor -- start 2024-02-26T12:20:03.579 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.591+0000 7f97f8374640 1 -- start start 2024-02-26T12:20:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc004800 0x7f97f01f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ab2d0 0x7f97f015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f015e210 con 0x7f97f00b1a80 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b6dc0 con 0x7f97dc004800 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cf2e0 con 0x7f97f00ab2d0 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58546/0 (socket says 172.21.15.113:58546) 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 -- 172.21.15.113:0/1307780566 learned_addr learned my addr 172.21.15.113:0/1307780566 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f590f640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ab2d0 0x7f97f015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6110640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc004800 0x7f97f01f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 -- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ab2d0 msgr2=0x7f97f015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ab2d0 0x7f97f015ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 -- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc004800 msgr2=0x7f97f01f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.582 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc004800 0x7f97f01f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 -- 172.21.15.113:0/1307780566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00abd50 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f6911640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97f00cef30 tx=0x7f97e8010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8010e70 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e801c070 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00ab790 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800eb50 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.592+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f015fcf0 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.593+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0074a50 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.594+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97e8012040 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.594+0000 7f97e6ffd640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.594+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97e8089fe0 con 0x7f97f00b1a80 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.594+0000 7f97f6110640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.594+0000 7f97f6110640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 0x7f97d406d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ca030 tx=0x7f97ec009760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.584 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.598+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f97e8012330 con 0x7f97f00b1a80 2024-02-26T12:20:03.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.770+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97f00d18d0 con 0x7f97f00b1a80 2024-02-26T12:20:03.755 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.770+0000 7f97e6ffd640 1 -- 172.21.15.113:0/1307780566 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97e80591b0 con 0x7f97f00b1a80 2024-02-26T12:20:03.755 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:20:03.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 msgr2=0x7f97d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 0x7f97d406d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ca030 tx=0x7f97ec009760 comp rx=0 tx=0).stop 2024-02-26T12:20:03.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 msgr2=0x7f97f00cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.758 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97f00cef30 tx=0x7f97e8010c80 comp rx=0 tx=0).stop 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 shutdown_connections 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f97d406b4d0 0x7f97d406d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97f00b1a80 0x7f97f00cce30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97f00ab2d0 0x7f97f015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 --2- 172.21.15.113:0/1307780566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97dc004800 0x7f97f01f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.759 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 >> 172.21.15.113:0/1307780566 conn(0x7f97f00d0610 msgr2=0x7f97f00d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 shutdown_connections 2024-02-26T12:20:03.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.772+0000 7f97f8374640 1 -- 172.21.15.113:0/1307780566 wait complete. 2024-02-26T12:20:03.768 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-26T12:20:03.868 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.883+0000 7fb8217dc640 1 Processor -- start 2024-02-26T12:20:03.869 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.883+0000 7fb8217dc640 1 -- start start 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb8217dc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c15def0 0x7fb81c0b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb8217dc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb81c0b2d80 0x7fb81c0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb8217dc640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81c0d1f50 con 0x7fb81c0d3530 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb8217dc640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0d2230 con 0x7fb81c0b2d80 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb8217dc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0d2510 con 0x7fb81c15def0 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb81a7fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb81c0b2d80 0x7fb81c0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb81b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb81c0d3530 0x7fb81c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57448/0 (socket says 172.21.15.113:57448) 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb81b7fe640 1 -- 172.21.15.113:0/1874032384 learned_addr learned my addr 172.21.15.113:0/1874032384 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.884+0000 7fb81affd640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c15def0 0x7fb81c0b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb81a7fc640 1 -- 172.21.15.113:0/1874032384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c15def0 msgr2=0x7fb81c0b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:03.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb81a7fc640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c15def0 0x7fb81c0b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb81a7fc640 1 -- 172.21.15.113:0/1874032384 >> v1:172.21.15.113:6789/0 conn(0x7fb81c0d3530 legacy=0x7fb81c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb81a7fc640 1 -- 172.21.15.113:0/1874032384 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0d27f0 con 0x7fb81c0b2d80 2024-02-26T12:20:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb81a7fc640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c0d2ff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb8100097a0 tx=0x7fb81002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b629490dc8541017 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb819ffb640 1 -- 172.21.15.113:0/1874032384 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810035020 con 0x7fb81c0b2d80 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb819ffb640 1 -- 172.21.15.113:0/1874032384 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810031830 con 0x7fb81c0b2d80 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.885+0000 7fb819ffb640 1 -- 172.21.15.113:0/1874032384 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810031c00 con 0x7fb81c0b2d80 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 -- 172.21.15.113:0/1874032384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 msgr2=0x7fb81c0d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c0d2ff0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb8100097a0 tx=0x7fb81002b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 -- 172.21.15.113:0/1874032384 shutdown_connections 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c0d2ff0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 --2- 172.21.15.113:0/1874032384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c15def0 0x7fb81c0b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 -- 172.21.15.113:0/1874032384 >> 172.21.15.113:0/1874032384 conn(0x7fb81c0728b0 msgr2=0x7fb81c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 -- 172.21.15.113:0/1874032384 shutdown_connections 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.886+0000 7fb8217dc640 1 -- 172.21.15.113:0/1874032384 wait complete. 2024-02-26T12:20:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.887+0000 7fb8217dc640 1 Processor -- start 2024-02-26T12:20:03.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.887+0000 7fb8217dc640 1 -- start start 2024-02-26T12:20:03.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c0d3530 0x7fb81c149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c14c6a0 0x7fb81c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0b9ac0 con 0x7fb81c0b2d80 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0b9940 con 0x7fb81c14c6a0 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb8217dc640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c0cefc0 con 0x7fb81c0d3530 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58558/0 (socket says 172.21.15.113:58558) 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 -- 172.21.15.113:0/2157335633 learned_addr learned my addr 172.21.15.113:0/2157335633 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 -- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c0d3530 msgr2=0x7fb81c149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c0d3530 0x7fb81c149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 -- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c14c6a0 msgr2=0x7fb81c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c14c6a0 0x7fb81c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.888+0000 7fb81affd640 1 -- 172.21.15.113:0/2157335633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c1e7c90 con 0x7fb81c0b2d80 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb81affd640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb80c007f20 tx=0x7fb80c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c014620 con 0x7fb81c0b2d80 2024-02-26T12:20:03.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c019070 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c014a00 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c14a290 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.889+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c14a850 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.890+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c074a50 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.890+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb80c014ba0 con 0x7fb81c0b2d80 2024-02-26T12:20:03.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.891+0000 7fb8037fe640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:03.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.891+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb80c08a740 con 0x7fb81c0b2d80 2024-02-26T12:20:03.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.891+0000 7fb81a7fc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:03.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.891+0000 7fb81a7fc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 0x7fb80806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb810036000 tx=0x7fb810030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:03.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:03.895+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb80c0599a0 con 0x7fb81c0b2d80 2024-02-26T12:20:04.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.068+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb81c160980 con 0x7fb81c0b2d80 2024-02-26T12:20:04.053 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.068+0000 7fb8037fe640 1 -- 172.21.15.113:0/2157335633 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb80c0592a0 con 0x7fb81c0b2d80 2024-02-26T12:20:04.053 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:[ 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout: { 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout: "poolnum": 1, 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout: "poolname": ".mgr" 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout: } 2024-02-26T12:20:04.054 INFO:teuthology.orchestra.run.smithi113.stdout:] 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 msgr2=0x7fb80806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 0x7fb80806d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb810036000 tx=0x7fb810030000 comp rx=0 tx=0).stop 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 msgr2=0x7fb81c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb80c007f20 tx=0x7fb80c00e570 comp rx=0 tx=0).stop 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 shutdown_connections 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb80806b4d0 0x7fb80806d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.055 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb81c14c6a0 0x7fb81c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb81c0d3530 0x7fb81c149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 --2- 172.21.15.113:0/2157335633 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb81c0b2d80 0x7fb81c14b330 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 >> 172.21.15.113:0/2157335633 conn(0x7fb81c0728b0 msgr2=0x7fb81c0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:04.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 shutdown_connections 2024-02-26T12:20:04.056 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.070+0000 7fb8217dc640 1 -- 172.21.15.113:0/2157335633 wait complete. 2024-02-26T12:20:04.066 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-26T12:20:04.066 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-26T12:20:04.171 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.186+0000 7f34b5869640 1 Processor -- start 2024-02-26T12:20:04.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.186+0000 7f34b5869640 1 -- start start 2024-02-26T12:20:04.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34b5869640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34b5869640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 0x7f34b00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34b5869640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b00b2920 con 0x7f34b015bca0 2024-02-26T12:20:04.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34b5869640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b00b1da0 con 0x7f34b00cf930 2024-02-26T12:20:04.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34b5869640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00b2080 con 0x7f34b00d02f0 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34af7fe640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 0x7f34b00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34ae7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34ae7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.113:39194/0 (socket says 172.21.15.113:39194) 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.187+0000 7f34aeffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f34b015bca0 0x7f34b00b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:41246/0 (socket says 172.21.15.113:41246) 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34ae7fc640 1 -- 172.21.15.113:0/3045873068 learned_addr learned my addr 172.21.15.113:0/3045873068 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34af7fe640 1 -- 172.21.15.113:0/3045873068 >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 msgr2=0x7f34b00cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34af7fe640 1 --2- 172.21.15.113:0/3045873068 >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34af7fe640 1 -- 172.21.15.113:0/3045873068 >> v1:172.21.15.152:6789/0 conn(0x7f34b015bca0 legacy=0x7f34b00b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34af7fe640 1 -- 172.21.15.113:0/3045873068 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00b2360 con 0x7f34b00d02f0 2024-02-26T12:20:04.174 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.188+0000 7f34ae7fc640 1 --2- 172.21.15.113:0/3045873068 >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:04.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34af7fe640 1 --2- 172.21.15.113:0/3045873068 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 0x7f34b00cc880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=411476484872522a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34adffb640 1 -- 172.21.15.113:0/3045873068 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8039070 con 0x7f34b00d02f0 2024-02-26T12:20:04.178 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34adffb640 1 -- 172.21.15.113:0/3045873068 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a802cc50 con 0x7f34b00d02f0 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34adffb640 1 -- 172.21.15.113:0/3045873068 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8034440 con 0x7f34b00d02f0 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 -- 172.21.15.113:0/3045873068 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 msgr2=0x7f34b00cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 --2- 172.21.15.113:0/3045873068 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 0x7f34b00cc880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009d90 tx=0x7f34a802bea0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 -- 172.21.15.113:0/3045873068 shutdown_connections 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 --2- 172.21.15.113:0/3045873068 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b00d02f0 0x7f34b00cc880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 --2- 172.21.15.113:0/3045873068 >> v2:172.21.15.152:3300/0 conn(0x7f34b00cf930 0x7f34b00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 -- 172.21.15.113:0/3045873068 >> 172.21.15.113:0/3045873068 conn(0x7f34b00d1920 msgr2=0x7f34b00d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 -- 172.21.15.113:0/3045873068 shutdown_connections 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.189+0000 7f34b5869640 1 -- 172.21.15.113:0/3045873068 wait complete. 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 Processor -- start 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 -- start start 2024-02-26T12:20:04.179 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b00d02f0 0x7f34b015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b015bca0 0x7f34b015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00ccdc0 con 0x7f34b00cf930 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00d0780 con 0x7f34b00d02f0 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.191+0000 7f34b5869640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b00ccf40 con 0x7f34b015bca0 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58574/0 (socket says 172.21.15.113:58574) 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 -- 172.21.15.113:0/4001781619 learned_addr learned my addr 172.21.15.113:0/4001781619 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34af7fe640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b015bca0 0x7f34b015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.180 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34ae7fc640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b00d02f0 0x7f34b015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 -- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b015bca0 msgr2=0x7f34b015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b015bca0 0x7f34b015ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 -- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b00d02f0 msgr2=0x7f34b015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b00d02f0 0x7f34b015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 -- 172.21.15.113:0/4001781619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b01572c0 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34aeffd640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c3c0 tx=0x7f34a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00074e0 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0007680 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b00b62c0 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0004a00 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.192+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b00b6880 con 0x7f34b00cf930 2024-02-26T12:20:04.181 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.193+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b0074a50 con 0x7f34b00cf930 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.194+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34a001a020 con 0x7f34b00cf930 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.194+0000 7f3497fff640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 0x7f349c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.194+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34a0089620 con 0x7f34b00cf930 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.194+0000 7f34ae7fc640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 0x7f349c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.195+0000 7f34ae7fc640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 0x7f349c06d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34b00c8aa0 tx=0x7f34a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.183 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.198+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34a00587f0 con 0x7f34b00cf930 2024-02-26T12:20:04.354 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.369+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f34b00c9290 con 0x7f34b00cf930 2024-02-26T12:20:04.798 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.813+0000 7f3497fff640 1 -- 172.21.15.113:0/4001781619 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f34a00580f0 con 0x7f34b00cf930 2024-02-26T12:20:04.799 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_metadata' created 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 msgr2=0x7f349c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 0x7f349c06d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34b00c8aa0 tx=0x7f34a4008040 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 msgr2=0x7f34b0156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c3c0 tx=0x7f34a000c880 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 shutdown_connections 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f349c06b4d0 0x7f349c06d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34b015bca0 0x7f34b015ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34b00d02f0 0x7f34b015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 --2- 172.21.15.113:0/4001781619 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f34b00cf930 0x7f34b0156d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 >> 172.21.15.113:0/4001781619 conn(0x7f34b00d1920 msgr2=0x7f34b0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 shutdown_connections 2024-02-26T12:20:04.801 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.815+0000 7f34b5869640 1 -- 172.21.15.113:0/4001781619 wait complete. 2024-02-26T12:20:04.815 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-26T12:20:04.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.942+0000 7fe1b7e95640 1 Processor -- start 2024-02-26T12:20:04.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.942+0000 7fe1b7e95640 1 -- start start 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b7e95640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe1b015f0a0 0x7fe1b015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b7e95640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe1b00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b7e95640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b00b2fd0 con 0x7fe1b015aad0 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b7e95640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00b3870 con 0x7fe1b015f0a0 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b7e95640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00b32b0 con 0x7fe1b015ea20 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b5c31640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe1b015aad0 0x7fe1b00b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57450/0 (socket says 172.21.15.113:57450) 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b5c31640 1 -- 172.21.15.113:0/1187046950 learned_addr learned my addr 172.21.15.113:0/1187046950 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616866757 0 0) 0x7fe1b00b2fd0 con 0x7fe1b015aad0 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c003520 con 0x7fe1b015aad0 2024-02-26T12:20:04.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b5430640 1 --2- 172.21.15.113:0/1187046950 >> v2:172.21.15.152:3300/0 conn(0x7fe1b015f0a0 0x7fe1b015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b6432640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe1b00cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1966073431 0 0) 0x7fe19c003520 con 0x7fe1b015aad0 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 msgr2=0x7fe1b00cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe1b00cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 >> v2:172.21.15.152:3300/0 conn(0x7fe1b015f0a0 msgr2=0x7fe1b015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 --2- 172.21.15.113:0/1187046950 >> v2:172.21.15.152:3300/0 conn(0x7fe1b015f0a0 0x7fe1b015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00b3590 con 0x7fe1b015aad0 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe1ac0019f0 con 0x7fe1b015aad0 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 >> v1:172.21.15.113:6789/0 conn(0x7fe1b015aad0 legacy=0x7fe1b00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe19c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c003f30 0x7fe19c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe19c004d40 0x7fe19c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.931 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00b3870 con 0x7fe19c004d40 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00b32b0 con 0x7fe19c003f30 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.943+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c00b9c0 con 0x7fe1b015ea20 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe19c004d40 0x7fe19c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b5430640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c003f30 0x7fe19c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b5c31640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe19c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 -- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 msgr2=0x7fe19c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b015ea20 0x7fe19c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 -- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c003f30 msgr2=0x7fe19c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe19c003f30 0x7fe19c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.944+0000 7fe1b6432640 1 -- 172.21.15.113:0/1187046950 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c003520 con 0x7fe19c004d40 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b6432640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe19c004d40 0x7fe19c0051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ac0 tx=0x7fe19c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a310d026bfa2cc server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8039070 con 0x7fe19c004d40 2024-02-26T12:20:04.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a802c6b0 con 0x7fe19c004d40 2024-02-26T12:20:04.933 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b4c2f640 1 -- 172.21.15.113:0/1187046950 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8009690 con 0x7fe19c004d40 2024-02-26T12:20:04.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 -- 172.21.15.113:0/1187046950 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe19c004d40 msgr2=0x7fe19c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.936 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/1187046950 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe19c004d40 0x7fe19c0051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ac0 tx=0x7fe19c005830 comp rx=0 tx=0).stop 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b6432640 1 -- 172.21.15.113:0/1187046950 reap_dead start 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 -- 172.21.15.113:0/1187046950 shutdown_connections 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 -- 172.21.15.113:0/1187046950 >> 172.21.15.113:0/1187046950 conn(0x7fe1b006ab50 msgr2=0x7fe1b006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 -- 172.21.15.113:0/1187046950 shutdown_connections 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.945+0000 7fe1b7e95640 1 -- 172.21.15.113:0/1187046950 wait complete. 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 Processor -- start 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 -- start start 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 0x7fe1b00b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 0x7fe1b00b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0071410 con 0x7fe1b0145ea0 2024-02-26T12:20:04.937 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0071290 con 0x7fe1b00cadf0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b7e95640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0071590 con 0x7fe1b00cb1d0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b6432640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b6432640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58592/0 (socket says 172.21.15.113:58592) 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b6432640 1 -- 172.21.15.113:0/3348631979 learned_addr learned my addr 172.21.15.113:0/3348631979 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b5430640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 0x7fe1b00b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.947+0000 7fe1b5c31640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 0x7fe1b00b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 -- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 msgr2=0x7fe1b00b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 0x7fe1b00b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 -- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 msgr2=0x7fe1b00b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 0x7fe1b00b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 -- 172.21.15.113:0/3348631979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b015cda0 con 0x7fe1b0145ea0 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b5c31640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 0x7fe1b00b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:04.938 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b5430640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 0x7fe1b00b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b6432640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ac0 tx=0x7fe1a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8039070 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8043070 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8009690 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00b08f0 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.948+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b00b0e50 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.949+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0074a50 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.950+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1a8003830 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.950+0000 7fe1a67fc640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 0x7fe19406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.950+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe1a80ab1a0 con 0x7fe1b0145ea0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.950+0000 7fe1b5c31640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 0x7fe19406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:04.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.950+0000 7fe1b5c31640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 0x7fe19406d930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac004bc0 tx=0x7fe1ac006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:04.940 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:04.955+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1a804c020 con 0x7fe1b0145ea0 2024-02-26T12:20:05.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.126+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe1b006c270 con 0x7fe1b0145ea0 2024-02-26T12:20:05.807 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.821+0000 7fe1a67fc640 1 -- 172.21.15.113:0/3348631979 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe1b00b08f0 con 0x7fe1b0145ea0 2024-02-26T12:20:05.807 INFO:teuthology.orchestra.run.smithi113.stderr:pool 'cephfs_data' created 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.824+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 msgr2=0x7fe19406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.824+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 0x7fe19406d930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac004bc0 tx=0x7fe1ac006040 comp rx=0 tx=0).stop 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.824+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 msgr2=0x7fe1b015d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.824+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ac0 tx=0x7fe1a8004730 comp rx=0 tx=0).stop 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 shutdown_connections 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe19406b470 0x7fe19406d930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe1b0145ea0 0x7fe1b015d540 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.810 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe1b00cb1d0 0x7fe1b00b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 --2- 172.21.15.113:0/3348631979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe1b00cadf0 0x7fe1b00b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 >> 172.21.15.113:0/3348631979 conn(0x7fe1b006ab50 msgr2=0x7fe1b006d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:05.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 shutdown_connections 2024-02-26T12:20:05.811 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.825+0000 7fe1b7e95640 1 -- 172.21.15.113:0/3348631979 wait complete. 2024-02-26T12:20:05.834 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-26T12:20:05.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.956+0000 7fce4e15e640 1 Processor -- start 2024-02-26T12:20:05.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.956+0000 7fce4e15e640 1 -- start start 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce4e15e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce480b26f0 0x7fce480ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce4e15e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480b2bf0 con 0x7fce4815a240 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce4e15e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480b2ed0 con 0x7fce480719a0 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce4e15e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480cd4f0 con 0x7fce480b26f0 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce47fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fce480b26f0 0x7fce480ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce477fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fce4815a240 0x7fce48071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57454/0 (socket says 172.21.15.113:57454) 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.957+0000 7fce477fe640 1 -- 172.21.15.113:0/4268284319 learned_addr learned my addr 172.21.15.113:0/4268284319 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce47fff640 1 -- 172.21.15.113:0/4268284319 >> v1:172.21.15.152:6789/0 conn(0x7fce480719a0 legacy=0x7fce4806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce47fff640 1 -- 172.21.15.113:0/4268284319 >> v1:172.21.15.113:6789/0 conn(0x7fce4815a240 legacy=0x7fce48071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce467fc640 1 -- 172.21.15.113:0/4268284319 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469661591 0 0) 0x7fce480b2bf0 con 0x7fce4815a240 2024-02-26T12:20:05.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce47fff640 1 -- 172.21.15.113:0/4268284319 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480b31b0 con 0x7fce480b26f0 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce47fff640 1 --2- 172.21.15.113:0/4268284319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce480ccfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4002cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c382e68c8334dc server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce467fc640 1 -- 172.21.15.113:0/4268284319 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4003a070 con 0x7fce480b26f0 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce467fc640 1 -- 172.21.15.113:0/4268284319 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4002dce0 con 0x7fce480b26f0 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.958+0000 7fce467fc640 1 -- 172.21.15.113:0/4268284319 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40035660 con 0x7fce480b26f0 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 -- 172.21.15.113:0/4268284319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 msgr2=0x7fce480ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 --2- 172.21.15.113:0/4268284319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce480ccfb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4002cf30 comp rx=0 tx=0).stop 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 -- 172.21.15.113:0/4268284319 shutdown_connections 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 --2- 172.21.15.113:0/4268284319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce480ccfb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 -- 172.21.15.113:0/4268284319 >> 172.21.15.113:0/4268284319 conn(0x7fce4806ab50 msgr2=0x7fce4806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 -- 172.21.15.113:0/4268284319 shutdown_connections 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.959+0000 7fce4e15e640 1 -- 172.21.15.113:0/4268284319 wait complete. 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.960+0000 7fce4e15e640 1 Processor -- start 2024-02-26T12:20:05.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.960+0000 7fce4e15e640 1 -- start start 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 0x7fce480afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 0x7fce48159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480aec20 con 0x7fce480b26f0 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480aeaa0 con 0x7fce481f4560 2024-02-26T12:20:05.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce4e15e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4806e7d0 con 0x7fce480719a0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58616/0 (socket says 172.21.15.113:58616) 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 -- 172.21.15.113:0/1645712152 learned_addr learned my addr 172.21.15.113:0/1645712152 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce477fe640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 0x7fce480afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce47fff640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 0x7fce48159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 -- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 msgr2=0x7fce480afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 0x7fce480afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 -- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 msgr2=0x7fce48159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 0x7fce48159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.961+0000 7fce46ffd640 1 -- 172.21.15.113:0/1645712152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48157a80 con 0x7fce480b26f0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce477fe640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 0x7fce480afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce47fff640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 0x7fce48159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce46ffd640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c430 tx=0x7fce3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:05.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c011790 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c017070 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48157d60 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c011b70 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.962+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48158840 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.963+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48074a50 con 0x7fce480b26f0 2024-02-26T12:20:05.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.963+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce3c011d10 con 0x7fce480b26f0 2024-02-26T12:20:05.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.964+0000 7fce2ffff640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 0x7fce3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:05.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.964+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fce3c089fa0 con 0x7fce480b26f0 2024-02-26T12:20:05.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.964+0000 7fce477fe640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 0x7fce3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:05.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.964+0000 7fce477fe640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 0x7fce3406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce38000f60 tx=0x7fce38007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:05.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:05.968+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce3c058f10 con 0x7fce480b26f0 2024-02-26T12:20:06.159 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.174+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fce4806e5b0 con 0x7fce480b26f0 2024-02-26T12:20:06.808 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.823+0000 7fce2ffff640 1 -- 172.21.15.113:0/1645712152 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fce3c058810 con 0x7fce480b26f0 2024-02-26T12:20:06.808 INFO:teuthology.orchestra.run.smithi113.stderr:new fs with metadata pool 4 and data pool 5 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.826+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 msgr2=0x7fce3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.826+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 0x7fce3406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce38000f60 tx=0x7fce38007cc0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.826+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 msgr2=0x7fce48158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.826+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c430 tx=0x7fce3c00c8f0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 shutdown_connections 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fce3406b4d0 0x7fce3406d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce481f4560 0x7fce48159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.812 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce480b26f0 0x7fce48158be0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 --2- 172.21.15.113:0/1645712152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fce480719a0 0x7fce480afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.827+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 >> 172.21.15.113:0/1645712152 conn(0x7fce4806ab50 msgr2=0x7fce4814ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:06.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.828+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 shutdown_connections 2024-02-26T12:20:06.813 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.829+0000 7fce4e15e640 1 -- 172.21.15.113:0/1645712152 wait complete. 2024-02-26T12:20:06.841 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:06.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.957+0000 7f9a74cde640 1 Processor -- start 2024-02-26T12:20:06.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.957+0000 7f9a74cde640 1 -- start start 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a74cde640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a7006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a74cde640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7006db50 con 0x7f9a70071900 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a74cde640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7006de30 con 0x7f9a7015b340 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a74cde640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006e760 con 0x7f9a70154600 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6ed9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9a70071900 0x7f9a700b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57462/0 (socket says 172.21.15.113:57462) 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6ed9d640 1 -- 172.21.15.113:0/3452321842 learned_addr learned my addr 172.21.15.113:0/3452321842 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a7006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17358303 0 0) 0x7f9a7006db50 con 0x7f9a70071900 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a58003520 con 0x7f9a70071900 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072584844 0 0) 0x7f9a7006de30 con 0x7f9a7015b340 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a7006db50 con 0x7f9a7015b340 2024-02-26T12:20:06.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762194332 0 0) 0x7f9a58003520 con 0x7f9a70071900 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 msgr2=0x7f9a7006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a7006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 >> v1:172.21.15.152:6789/0 conn(0x7f9a7015b340 legacy=0x7f9a700711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7006e110 con 0x7f9a70071900 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f9a68001670 con 0x7f9a70071900 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a7006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 >> v1:172.21.15.113:6789/0 conn(0x7f9a70071900 legacy=0x7f9a700b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a58003b70 0x7f9a58003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006e760 con 0x7f9a58004800 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800dc80 con 0x7f9a58003b70 2024-02-26T12:20:06.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.958+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5800de30 con 0x7f9a70154600 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a58003b70 0x7f9a58003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6ed9d640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 -- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 msgr2=0x7f9a580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a70154600 0x7f9a580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 -- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a58003b70 msgr2=0x7f9a58003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a58003b70 0x7f9a58003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 -- 172.21.15.113:0/3452321842 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a58003520 con 0x7f9a58004800 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.959+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a58004c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a640018a0 tx=0x7f9a58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2740c86b7f499d23 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64037070 con 0x7f9a58004800 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640052d0 con 0x7f9a58004800 2024-02-26T12:20:06.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a6d59a640 1 -- 172.21.15.113:0/3452321842 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640014f0 con 0x7f9a58004800 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 -- 172.21.15.113:0/3452321842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 msgr2=0x7f9a58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 --2- 172.21.15.113:0/3452321842 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a58004c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a640018a0 tx=0x7f9a58005830 comp rx=0 tx=0).stop 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a6ed9d640 1 -- 172.21.15.113:0/3452321842 reap_dead start 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 -- 172.21.15.113:0/3452321842 shutdown_connections 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 -- 172.21.15.113:0/3452321842 >> 172.21.15.113:0/3452321842 conn(0x7f9a7006ab50 msgr2=0x7f9a7006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 -- 172.21.15.113:0/3452321842 shutdown_connections 2024-02-26T12:20:06.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.960+0000 7f9a74cde640 1 -- 172.21.15.113:0/3452321842 wait complete. 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 Processor -- start 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 -- start start 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a700adf20 0x7f9a701e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a701e4e20 0x7f9a70152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70154b60 con 0x7f9a58004800 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a701549e0 con 0x7f9a700adf20 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a74cde640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006d250 con 0x7f9a701e4e20 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a6e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a6e59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58644/0 (socket says 172.21.15.113:58644) 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.962+0000 7f9a6e59c640 1 -- 172.21.15.113:0/1456201637 learned_addr learned my addr 172.21.15.113:0/1456201637 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a700adf20 0x7f9a701e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6ed9d640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a701e4e20 0x7f9a70152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 -- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a701e4e20 msgr2=0x7f9a70152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a701e4e20 0x7f9a70152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 -- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a700adf20 msgr2=0x7f9a701e48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a700adf20 0x7f9a701e48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 -- 172.21.15.113:0/1456201637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a701f8140 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a6e59c640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a60008ef0 tx=0x7f9a600075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60003b90 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60003d30 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a701f4b70 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60004240 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.963+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a701f42d0 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.964+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a700aed80 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.964+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a600043e0 con 0x7f9a58004800 2024-02-26T12:20:06.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.965+0000 7f9a5effd640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:06.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.965+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a6008a5b0 con 0x7f9a58004800 2024-02-26T12:20:06.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.965+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:06.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.965+0000 7f9a6dd9b640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 0x7f9a5006d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a64034000 tx=0x7f9a64031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:06.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:06.969+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a700aed80 con 0x7f9a58004800 2024-02-26T12:20:07.126 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.141+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a70158370 con 0x7f9a58004800 2024-02-26T12:20:07.127 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.142+0000 7f9a5effd640 1 -- 172.21.15.113:0/1456201637 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f9a701f8140 con 0x7f9a58004800 2024-02-26T12:20:07.128 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:07.128 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":30,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:06.175745+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:20:04.388376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-26T12:20:05.144745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:07.129 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 msgr2=0x7f9a5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 0x7f9a5006d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9a64034000 tx=0x7f9a64031000 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 msgr2=0x7f9a701f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a60008ef0 tx=0x7f9a600075c0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 shutdown_connections 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9a701e4e20 0x7f9a70152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a700adf20 0x7f9a701e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 --2- 172.21.15.113:0/1456201637 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a58004800 0x7f9a701f7c00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 >> 172.21.15.113:0/1456201637 conn(0x7f9a7006ab50 msgr2=0x7f9a700ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 shutdown_connections 2024-02-26T12:20:07.130 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.144+0000 7f9a74cde640 1 -- 172.21.15.113:0/1456201637 wait complete. 2024-02-26T12:20:07.141 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:07.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.255+0000 7f0d98ca6640 1 Processor -- start 2024-02-26T12:20:07.241 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.255+0000 7f0d98ca6640 1 -- start start 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.256+0000 7f0d98ca6640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d9415ddf0 0x7f0d94070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.256+0000 7f0d98ca6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9406b700 con 0x7f0d940cac50 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.256+0000 7f0d98ca6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9406b9e0 con 0x7f0d940cf930 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.256+0000 7f0d98ca6640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9406bcc0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d9259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d9415ddf0 0x7f0d94070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d92d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f0d940cac50 0x7f0d94167800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57470/0 (socket says 172.21.15.113:57470) 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d92d9d640 1 -- 172.21.15.113:0/1313776057 learned_addr learned my addr 172.21.15.113:0/1313776057 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d9259c640 1 -- 172.21.15.113:0/1313776057 >> v1:172.21.15.152:6789/0 conn(0x7f0d940cf930 legacy=0x7f0d940ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:07.242 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d9259c640 1 -- 172.21.15.113:0/1313776057 >> v1:172.21.15.113:6789/0 conn(0x7f0d940cac50 legacy=0x7f0d94167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d9159a640 1 -- 172.21.15.113:0/1313776057 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987237831 0 0) 0x7f0d9406b700 con 0x7f0d940cac50 2024-02-26T12:20:07.243 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.257+0000 7f0d9259c640 1 -- 172.21.15.113:0/1313776057 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9406bfa0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d9259c640 1 --2- 172.21.15.113:0/1313776057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94070010 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097a0 tx=0x7f0d8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d4e7d2562d1b0a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d9159a640 1 -- 172.21.15.113:0/1313776057 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d880315a0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d9159a640 1 -- 172.21.15.113:0/1313776057 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88037070 con 0x7f0d9415ddf0 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d9159a640 1 -- 172.21.15.113:0/1313776057 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88031960 con 0x7f0d9415ddf0 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 -- 172.21.15.113:0/1313776057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 msgr2=0x7f0d94070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/1313776057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94070010 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d880097a0 tx=0x7f0d8802b840 comp rx=0 tx=0).stop 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 -- 172.21.15.113:0/1313776057 shutdown_connections 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/1313776057 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94070010 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.244 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 -- 172.21.15.113:0/1313776057 >> 172.21.15.113:0/1313776057 conn(0x7f0d940cc970 msgr2=0x7f0d940ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 -- 172.21.15.113:0/1313776057 shutdown_connections 2024-02-26T12:20:07.245 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.258+0000 7f0d98ca6640 1 -- 172.21.15.113:0/1313776057 wait complete. 2024-02-26T12:20:07.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 Processor -- start 2024-02-26T12:20:07.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 -- start start 2024-02-26T12:20:07.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d940cac50 0x7f0d940a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 0x7f0d94071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.247 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d94168f20 con 0x7f0d9415ddf0 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940cee40 con 0x7f0d940cf930 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d98ca6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941690a0 con 0x7f0d940cac50 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d92d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d92d9d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58674/0 (socket says 172.21.15.113:58674) 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.260+0000 7f0d92d9d640 1 -- 172.21.15.113:0/40235576 learned_addr learned my addr 172.21.15.113:0/40235576 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:07.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 -- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d940cac50 msgr2=0x7f0d940a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d9259c640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d940cac50 0x7f0d940a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d91d9b640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 0x7f0d94071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d940cac50 0x7f0d940a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 -- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 msgr2=0x7f0d94071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 0x7f0d94071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 -- 172.21.15.113:0/40235576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940c96c0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d91d9b640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 0x7f0d94071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d92d9d640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c700 tx=0x7f0d8c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c018070 con 0x7f0d9415ddf0 2024-02-26T12:20:07.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c00ce10 con 0x7f0d9415ddf0 2024-02-26T12:20:07.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d940c99a0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00a860 con 0x7f0d9415ddf0 2024-02-26T12:20:07.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.261+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d940a1310 con 0x7f0d9415ddf0 2024-02-26T12:20:07.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.262+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d940c3d10 con 0x7f0d9415ddf0 2024-02-26T12:20:07.250 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.262+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d8c01b070 con 0x7f0d9415ddf0 2024-02-26T12:20:07.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.263+0000 7f0d82ffd640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 0x7f0d7406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.263+0000 7f0d9259c640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 0x7f0d7406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.263+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c0897b0 con 0x7f0d9415ddf0 2024-02-26T12:20:07.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.263+0000 7f0d9259c640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 0x7f0d7406d9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d88036000 tx=0x7f0d88008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.267+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d8c058630 con 0x7f0d9415ddf0 2024-02-26T12:20:07.422 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.437+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d94074a50 con 0x7f0d9415ddf0 2024-02-26T12:20:07.423 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.438+0000 7f0d82ffd640 1 -- 172.21.15.113:0/40235576 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16706 (secure 0 0 0) 0x7f0d8c057f30 con 0x7f0d9415ddf0 2024-02-26T12:20:07.424 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:07.424 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":30,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:06.175745+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:20:04.388376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-26T12:20:05.144745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:07.426 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 msgr2=0x7f0d7406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 0x7f0d7406d9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d88036000 tx=0x7f0d88008030 comp rx=0 tx=0).stop 2024-02-26T12:20:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 msgr2=0x7f0d94072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.427 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c700 tx=0x7f0d8c00cbc0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 shutdown_connections 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f0d7406b500 0x7f0d7406d9c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d9415ddf0 0x7f0d94072250 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d940cf930 0x7f0d94071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 --2- 172.21.15.113:0/40235576 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d940cac50 0x7f0d940a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 >> 172.21.15.113:0/40235576 conn(0x7f0d940cc970 msgr2=0x7f0d9406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 shutdown_connections 2024-02-26T12:20:07.428 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.440+0000 7f0d98ca6640 1 -- 172.21.15.113:0/40235576 wait complete. 2024-02-26T12:20:07.437 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-26T12:20:07.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.555+0000 7f8ed762d640 1 Processor -- start 2024-02-26T12:20:07.540 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.555+0000 7f8ed762d640 1 -- start start 2024-02-26T12:20:07.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed762d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8ed015af30 0x7f8ed006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed762d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed015b430 con 0x7f8ed0154eb0 2024-02-26T12:20:07.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed762d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed015b710 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.541 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed762d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00ce360 con 0x7f8ed015af30 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed4bc8640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8ed015af30 0x7f8ed006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed53c9640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f8ed0154eb0 0x7f8ed0071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:57472/0 (socket says 172.21.15.113:57472) 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed53c9640 1 -- 172.21.15.113:0/3904399127 learned_addr learned my addr 172.21.15.113:0/3904399127 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed4bc8640 1 -- 172.21.15.113:0/3904399127 >> v1:172.21.15.152:6789/0 conn(0x7f8ed00cb3b0 legacy=0x7f8ed00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed4bc8640 1 -- 172.21.15.113:0/3904399127 >> v1:172.21.15.113:6789/0 conn(0x7f8ed0154eb0 legacy=0x7f8ed0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ed4bc8640 1 -- 172.21.15.113:0/3904399127 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed015b9f0 con 0x7f8ed015af30 2024-02-26T12:20:07.542 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.556+0000 7f8ec7fff640 1 -- 172.21.15.113:0/3904399127 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544672867 0 0) 0x7f8ed015b430 con 0x7f8ed0154eb0 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.557+0000 7f8ed4bc8640 1 --2- 172.21.15.113:0/3904399127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed015af30 0x7f8ed006f2b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097a0 tx=0x7f8ec002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01e7dc1e32e1675 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.557+0000 7f8ec7fff640 1 -- 172.21.15.113:0/3904399127 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00315a0 con 0x7f8ed015af30 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.557+0000 7f8ec7fff640 1 -- 172.21.15.113:0/3904399127 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0037070 con 0x7f8ed015af30 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.557+0000 7f8ec7fff640 1 -- 172.21.15.113:0/3904399127 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0031960 con 0x7f8ed015af30 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 -- 172.21.15.113:0/3904399127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed015af30 msgr2=0x7f8ed006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.543 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 --2- 172.21.15.113:0/3904399127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed015af30 0x7f8ed006f2b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00097a0 tx=0x7f8ec002b840 comp rx=0 tx=0).stop 2024-02-26T12:20:07.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 -- 172.21.15.113:0/3904399127 shutdown_connections 2024-02-26T12:20:07.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 --2- 172.21.15.113:0/3904399127 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed015af30 0x7f8ed006f2b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 -- 172.21.15.113:0/3904399127 >> 172.21.15.113:0/3904399127 conn(0x7f8ed00cc100 msgr2=0x7f8ed00cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 -- 172.21.15.113:0/3904399127 shutdown_connections 2024-02-26T12:20:07.544 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.558+0000 7f8ed762d640 1 -- 172.21.15.113:0/3904399127 wait complete. 2024-02-26T12:20:07.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 Processor -- start 2024-02-26T12:20:07.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 -- start start 2024-02-26T12:20:07.546 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 0x7f8ed0142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8ed015af30 0x7f8ed0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00ccf60 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00ccde0 con 0x7f8ed0154eb0 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.559+0000 7f8ed762d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0155290 con 0x7f8ed015af30 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58692/0 (socket says 172.21.15.113:58692) 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 -- 172.21.15.113:0/97934277 learned_addr learned my addr 172.21.15.113:0/97934277 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed4bc8640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 0x7f8ed0142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed5bca640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8ed015af30 0x7f8ed0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 -- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8ed015af30 msgr2=0x7f8ed0144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8ed015af30 0x7f8ed0144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 -- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 msgr2=0x7f8ed0142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 0x7f8ed0142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 -- 172.21.15.113:0/97934277 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed01465e0 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed4bc8640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 0x7f8ed0142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed53c9640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c4d0 tx=0x7f8ecc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc018070 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc007500 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc004a20 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed0143b30 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.560+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed01440f0 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.561+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed0074a50 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.562+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ecc01b070 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.562+0000 7f8ec5ffb640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 0x7f8eb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.562+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ecc089510 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.562+0000 7f8ed4bc8640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 0x7f8eb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.562+0000 7f8ed4bc8640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 0x7f8eb406d9c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0036000 tx=0x7f8ec003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.566+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ed01465e0 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.761 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.776+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ed0072490 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.822 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.836+0000 7f8ec5ffb640 1 -- 172.21.15.113:0/97934277 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ecc058390 con 0x7f8ed00cb3b0 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 msgr2=0x7f8eb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 0x7f8eb406d9c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0036000 tx=0x7f8ec003d040 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 msgr2=0x7f8ed01460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00c4d0 tx=0x7f8ecc00c990 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 shutdown_connections 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f8eb406b500 0x7f8eb406d9c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8ed015af30 0x7f8ed0144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ed0154eb0 0x7f8ed0142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 --2- 172.21.15.113:0/97934277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed00cb3b0 0x7f8ed01460a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 >> 172.21.15.113:0/97934277 conn(0x7f8ed00cc100 msgr2=0x7f8ed00ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 shutdown_connections 2024-02-26T12:20:07.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.839+0000 7f8ed762d640 1 -- 172.21.15.113:0/97934277 wait complete. 2024-02-26T12:20:07.835 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-02-26T12:20:07.835 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-02-26T12:20:07.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 Processor -- start 2024-02-26T12:20:07.939 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 -- start start 2024-02-26T12:20:07.941 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffab015de30 0x7ffab00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00b5b50 0x7ffab00ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffab00ce930 0x7ffab006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00b5fb0 con 0x7ffab00ce930 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00cedc0 con 0x7ffab015de30 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.954+0000 7ffab491e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0161d50 con 0x7ffab00b5b50 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffab00ce930 0x7ffab006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffab00ce930 0x7ffab006c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58704/0 (socket says 172.21.15.113:58704) 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 -- 172.21.15.113:0/835821138 learned_addr learned my addr 172.21.15.113:0/835821138 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaae59c640 1 --2- 172.21.15.113:0/835821138 >> v2:172.21.15.152:3300/0 conn(0x7ffab015de30 0x7ffab00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaa7fff640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00b5b50 0x7ffab00ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.942 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 -- 172.21.15.113:0/835821138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00b5b50 msgr2=0x7ffab00ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00b5b50 0x7ffab00ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 -- 172.21.15.113:0/835821138 >> v2:172.21.15.152:3300/0 conn(0x7ffab015de30 msgr2=0x7ffab00b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 --2- 172.21.15.113:0/835821138 >> v2:172.21.15.152:3300/0 conn(0x7ffab015de30 0x7ffab00b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.955+0000 7ffaaed9d640 1 -- 172.21.15.113:0/835821138 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00d1dc0 con 0x7ffab00ce930 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffaaed9d640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00ce930 0x7ffab006c040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b65b0 tx=0x7ffaa802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2841ac93be4c09ba server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffaadd9b640 1 -- 172.21.15.113:0/835821138 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa802ca50 con 0x7ffab00ce930 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffaadd9b640 1 -- 172.21.15.113:0/835821138 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa802cbf0 con 0x7ffab00ce930 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffaadd9b640 1 -- 172.21.15.113:0/835821138 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80343f0 con 0x7ffab00ce930 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 -- 172.21.15.113:0/835821138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00ce930 msgr2=0x7ffab006c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00ce930 0x7ffab006c040 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b65b0 tx=0x7ffaa802beb0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 -- 172.21.15.113:0/835821138 shutdown_connections 2024-02-26T12:20:07.943 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00ce930 0x7ffab006c040 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 --2- 172.21.15.113:0/835821138 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00b5b50 0x7ffab00ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 --2- 172.21.15.113:0/835821138 >> v2:172.21.15.152:3300/0 conn(0x7ffab015de30 0x7ffab00b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 -- 172.21.15.113:0/835821138 >> 172.21.15.113:0/835821138 conn(0x7ffab00d0610 msgr2=0x7ffab00d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:07.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 -- 172.21.15.113:0/835821138 shutdown_connections 2024-02-26T12:20:07.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.956+0000 7ffab491e640 1 -- 172.21.15.113:0/835821138 wait complete. 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 Processor -- start 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 -- start start 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 0x7ffab00d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab015de30 0x7ffab00d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00d2340 con 0x7ffab00b5b50 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00d2060 con 0x7ffab015de30 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffab491e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b6dc0 con 0x7ffab00ce930 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:58708/0 (socket says 172.21.15.113:58708) 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.958+0000 7ffaae59c640 1 -- 172.21.15.113:0/1642177925 learned_addr learned my addr 172.21.15.113:0/1642177925 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaa7fff640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 0x7ffab00d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaaed9d640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab015de30 0x7ffab00d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 -- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 msgr2=0x7ffab00d3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 0x7ffab00d3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 -- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab015de30 msgr2=0x7ffab00d3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab015de30 0x7ffab00d3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 -- 172.21.15.113:0/1642177925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0153f40 con 0x7ffab00b5b50 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaa7fff640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 0x7ffab00d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:07.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaae59c640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d5f0 tx=0x7ffaa000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00125f0 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0019070 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab01557a0 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00129d0 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.959+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01f4d10 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.960+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab0074a50 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.961+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffaa0012b70 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.961+0000 7ffaa6ffd640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 0x7ffa9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.961+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaa008a610 con 0x7ffab00b5b50 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.961+0000 7ffaa7fff640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 0x7ffa9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:07.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.961+0000 7ffaa7fff640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 0x7ffa9006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa98006fd0 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:07.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:07.965+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffab0153f40 con 0x7ffab00b5b50 2024-02-26T12:20:08.158 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.173+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffab00d18d0 con 0x7ffab00b5b50 2024-02-26T12:20:08.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.841+0000 7ffaa6ffd640 1 -- 172.21.15.113:0/1642177925 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffaa0059490 con 0x7ffab00b5b50 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 msgr2=0x7ffa9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 0x7ffa9006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa98006fd0 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 msgr2=0x7ffab0153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000d5f0 tx=0x7ffaa000dab0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 shutdown_connections 2024-02-26T12:20:08.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ffa9006b4d0 0x7ffa9006d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffab015de30 0x7ffab00d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffab00ce930 0x7ffab00d3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 --2- 172.21.15.113:0/1642177925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffab00b5b50 0x7ffab0153a00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 >> 172.21.15.113:0/1642177925 conn(0x7ffab00d0610 msgr2=0x7ffab00b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 shutdown_connections 2024-02-26T12:20:08.830 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.844+0000 7ffab491e640 1 -- 172.21.15.113:0/1642177925 wait complete. 2024-02-26T12:20:08.842 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-02-26T12:20:08.842 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:20:08.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 Processor -- start 2024-02-26T12:20:08.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 -- start start 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f294c0b2d80 0x7f294c0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c0d1f50 con 0x7f294c15def0 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c0d2230 con 0x7f294c0d3530 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.964+0000 7f295091e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c0d2510 con 0x7f294c0b2d80 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f2943fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f294c0b2d80 0x7f294c0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f294a59c640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f294c15def0 0x7f294c0b9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54712/0 (socket says 172.21.15.113:54712) 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f294a59c640 1 -- 172.21.15.113:0/899124755 learned_addr learned my addr 172.21.15.113:0/899124755 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f2943fff640 1 -- 172.21.15.113:0/899124755 >> v1:172.21.15.152:6789/0 conn(0x7f294c0d3530 legacy=0x7f294c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f2943fff640 1 -- 172.21.15.113:0/899124755 >> v1:172.21.15.113:6789/0 conn(0x7f294c15def0 legacy=0x7f294c0b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f2943fff640 1 -- 172.21.15.113:0/899124755 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0d27f0 con 0x7f294c0b2d80 2024-02-26T12:20:08.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.965+0000 7f2949d9b640 1 -- 172.21.15.113:0/899124755 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770767962 0 0) 0x7f294c0d1f50 con 0x7f294c15def0 2024-02-26T12:20:08.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f2943fff640 1 --2- 172.21.15.113:0/899124755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0b2d80 0x7f294c0d2ff0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f29340097d0 tx=0x7f293402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e20fe40b7d0cb0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f2949d9b640 1 -- 172.21.15.113:0/899124755 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934035020 con 0x7f294c0b2d80 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f2949d9b640 1 -- 172.21.15.113:0/899124755 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934031830 con 0x7f294c0b2d80 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f2949d9b640 1 -- 172.21.15.113:0/899124755 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934031c00 con 0x7f294c0b2d80 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 -- 172.21.15.113:0/899124755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0b2d80 msgr2=0x7f294c0d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 --2- 172.21.15.113:0/899124755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0b2d80 0x7f294c0d2ff0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f29340097d0 tx=0x7f293402b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 -- 172.21.15.113:0/899124755 shutdown_connections 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 --2- 172.21.15.113:0/899124755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0b2d80 0x7f294c0d2ff0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 -- 172.21.15.113:0/899124755 >> 172.21.15.113:0/899124755 conn(0x7f294c0728b0 msgr2=0x7f294c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 -- 172.21.15.113:0/899124755 shutdown_connections 2024-02-26T12:20:08.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.966+0000 7f295091e640 1 -- 172.21.15.113:0/899124755 wait complete. 2024-02-26T12:20:08.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 Processor -- start 2024-02-26T12:20:08.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 -- start start 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f294c0b2d80 0x7f294c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f294c15ffc0 0x7f294c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0cf140 con 0x7f294c0d3530 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0cefc0 con 0x7f294c15ffc0 2024-02-26T12:20:08.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.968+0000 7f295091e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0b6c10 con 0x7f294c0b2d80 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59280/0 (socket says 172.21.15.113:59280) 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 -- 172.21.15.113:0/1897616987 learned_addr learned my addr 172.21.15.113:0/1897616987 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f294ad9d640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f294c15ffc0 0x7f294c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f294a59c640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f294c0b2d80 0x7f294c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 -- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f294c0b2d80 msgr2=0x7f294c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f294c0b2d80 0x7f294c1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 -- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f294c15ffc0 msgr2=0x7f294c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f294c15ffc0 0x7f294c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 -- 172.21.15.113:0/1897616987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c153320 con 0x7f294c0d3530 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2943fff640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f29340097d0 tx=0x7f29340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934004230 con 0x7f294c0d3530 2024-02-26T12:20:08.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340043d0 con 0x7f294c0d3530 2024-02-26T12:20:08.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c152e30 con 0x7f294c0d3530 2024-02-26T12:20:08.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293403cad0 con 0x7f294c0d3530 2024-02-26T12:20:08.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.969+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c1608d0 con 0x7f294c0d3530 2024-02-26T12:20:08.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.970+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c074a50 con 0x7f294c0d3530 2024-02-26T12:20:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.971+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2934038020 con 0x7f294c0d3530 2024-02-26T12:20:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.971+0000 7f2942ffd640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 0x7f292c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.971+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29340ac3c0 con 0x7f294c0d3530 2024-02-26T12:20:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.971+0000 7f294a59c640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 0x7f292c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:08.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.971+0000 7f294a59c640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 0x7f292c06d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f293c000f60 tx=0x7f293c007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:08.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:08.975+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2934041070 con 0x7f294c0d3530 2024-02-26T12:20:09.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.184+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f294c0cdbd0 con 0x7f294c0d3530 2024-02-26T12:20:09.169 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.184+0000 7f2942ffd640 1 -- 172.21.15.113:0/1897616987 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f293407b2d0 con 0x7f294c0d3530 2024-02-26T12:20:09.170 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:09.170 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/584883378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":584883378},{"type":"v1","addr":"172.21.15.113:6837","nonce":584883378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6834/125186533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":125186533},{"type":"v1","addr":"172.21.15.152:6834","nonce":125186533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/963040340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":963040340},{"type":"v1","addr":"172.21.15.152:6835","nonce":963040340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:20:06.176062+0000","modified":"2024-02-26T12:20:08.174361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6835/2648726034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2648726034},{"type":"v1","addr":"172.21.15.113:6835","nonce":2648726034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-26T12:20:09.170 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 14 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 msgr2=0x7f292c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 0x7f292c06d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f293c000f60 tx=0x7f293c007c00 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 msgr2=0x7f294c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f29340097d0 tx=0x7f29340046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 shutdown_connections 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f292c06b4d0 0x7f292c06d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f294c15ffc0 0x7f294c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f294c0d3530 0x7f294c15fa80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 --2- 172.21.15.113:0/1897616987 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f294c0b2d80 0x7f294c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 >> 172.21.15.113:0/1897616987 conn(0x7f294c0728b0 msgr2=0x7f294c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.172 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 shutdown_connections 2024-02-26T12:20:09.173 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.186+0000 7f295091e640 1 -- 172.21.15.113:0/1897616987 wait complete. 2024-02-26T12:20:09.182 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:09.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 Processor -- start 2024-02-26T12:20:09.283 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 -- start start 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc15ddf0 0x7f71bc070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71bc0cac50 0x7f71bc167800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc06b700 con 0x7f71bc0cf930 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc06b9e0 con 0x7f71bc0cac50 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.298+0000 7f71c3d55640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc06bcc0 con 0x7f71bc15ddf0 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71bc0cac50 0x7f71bc167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71bc0cac50 0x7f71bc167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59296/0 (socket says 172.21.15.113:59296) 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 -- 172.21.15.113:0/1088902214 learned_addr learned my addr 172.21.15.113:0/1088902214 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 -- 172.21.15.113:0/1088902214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc15ddf0 msgr2=0x7f71bc070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c1af1640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc15ddf0 0x7f71bc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc15ddf0 0x7f71bc070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 -- 172.21.15.113:0/1088902214 >> v1:172.21.15.152:6789/0 conn(0x7f71bc0cf930 legacy=0x7f71bc0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:09.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.299+0000 7f71c22f2640 1 -- 172.21.15.113:0/1088902214 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc06bfa0 con 0x7f71bc0cac50 2024-02-26T12:20:09.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c22f2640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc0cac50 0x7f71bc167800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a1bb35ef8e1bfe server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c0aef640 1 -- 172.21.15.113:0/1088902214 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40317c0 con 0x7f71bc0cac50 2024-02-26T12:20:09.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c0aef640 1 -- 172.21.15.113:0/1088902214 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4037070 con 0x7f71bc0cac50 2024-02-26T12:20:09.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c0aef640 1 -- 172.21.15.113:0/1088902214 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4031b80 con 0x7f71bc0cac50 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 -- 172.21.15.113:0/1088902214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc0cac50 msgr2=0x7f71bc167800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc0cac50 0x7f71bc167800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b402b860 comp rx=0 tx=0).stop 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 -- 172.21.15.113:0/1088902214 shutdown_connections 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc0cac50 0x7f71bc167800 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 --2- 172.21.15.113:0/1088902214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc15ddf0 0x7f71bc070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 -- 172.21.15.113:0/1088902214 >> 172.21.15.113:0/1088902214 conn(0x7f71bc0cc970 msgr2=0x7f71bc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.300+0000 7f71c3d55640 1 -- 172.21.15.113:0/1088902214 shutdown_connections 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.301+0000 7f71c3d55640 1 -- 172.21.15.113:0/1088902214 wait complete. 2024-02-26T12:20:09.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 Processor -- start 2024-02-26T12:20:09.288 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 -- start start 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc0cac50 0x7f71bc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 0x7f71bc160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc167d40 con 0x7f71bc15ddf0 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc0cee40 con 0x7f71bc0cf930 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c3d55640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc167ec0 con 0x7f71bc0cac50 2024-02-26T12:20:09.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c22f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c22f2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59312/0 (socket says 172.21.15.113:59312) 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.302+0000 7f71c22f2640 1 -- 172.21.15.113:0/3795848799 learned_addr learned my addr 172.21.15.113:0/3795848799 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 -- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc0cac50 msgr2=0x7f71bc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc0cac50 0x7f71bc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 -- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 msgr2=0x7f71bc160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c12f0640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 0x7f71bc160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 0x7f71bc160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 -- 172.21.15.113:0/3795848799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc1f3c90 con 0x7f71bc15ddf0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c12f0640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 0x7f71bc160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c22f2640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4032860 con 0x7f71bc15ddf0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4032a00 con 0x7f71bc15ddf0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc1f3f70 con 0x7f71bc15ddf0 2024-02-26T12:20:09.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4032df0 con 0x7f71bc15ddf0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.303+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc1f4530 con 0x7f71bc15ddf0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.304+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc074a50 con 0x7f71bc15ddf0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.304+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71b404c060 con 0x7f71bc15ddf0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.305+0000 7f71ba7fc640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.305+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71b40abe20 con 0x7f71bc15ddf0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.305+0000 7f71c1af1640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.305+0000 7f71c1af1640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 0x7f71a806d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e60 tx=0x7f71ac007390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.294 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.309+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71b4040070 con 0x7f71bc15ddf0 2024-02-26T12:20:09.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.480+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71bc06db70 con 0x7f71bc15ddf0 2024-02-26T12:20:09.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.481+0000 7f71ba7fc640 1 -- 172.21.15.113:0/3795848799 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f71b407ad30 con 0x7f71bc15ddf0 2024-02-26T12:20:09.466 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:09.466 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":31,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:07.833837+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:20:04.388376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-26T12:20:05.144745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 msgr2=0x7f71a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 0x7f71a806d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e60 tx=0x7f71ac007390 comp rx=0 tx=0).stop 2024-02-26T12:20:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 msgr2=0x7f71bc0719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b40046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 shutdown_connections 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f71bc15ddf0 0x7f71bc0719d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71bc0cf930 0x7f71bc160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 --2- 172.21.15.113:0/3795848799 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f71bc0cac50 0x7f71bc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 >> 172.21.15.113:0/3795848799 conn(0x7f71bc0cc970 msgr2=0x7f71bc0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 shutdown_connections 2024-02-26T12:20:09.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.483+0000 7f71c3d55640 1 -- 172.21.15.113:0/3795848799 wait complete. 2024-02-26T12:20:09.479 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-26T12:20:09.479 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:09.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.594+0000 7f10b7ad1640 1 Processor -- start 2024-02-26T12:20:09.580 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.595+0000 7f10b7ad1640 1 -- start start 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.595+0000 7f10b7ad1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f10b00b2d80 0x7f10b00d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.595+0000 7f10b7ad1640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00d1f50 con 0x7f10b015def0 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.595+0000 7f10b7ad1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00d2230 con 0x7f10b00d3530 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.595+0000 7f10b7ad1640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b00d2510 con 0x7f10b00b2d80 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b506c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f10b00b2d80 0x7f10b00d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b586d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f10b015def0 0x7f10b00b9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54714/0 (socket says 172.21.15.113:54714) 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b586d640 1 -- 172.21.15.113:0/2253800533 learned_addr learned my addr 172.21.15.113:0/2253800533 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b506c640 1 -- 172.21.15.113:0/2253800533 >> v1:172.21.15.152:6789/0 conn(0x7f10b00d3530 legacy=0x7f10b00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b506c640 1 -- 172.21.15.113:0/2253800533 >> v1:172.21.15.113:6789/0 conn(0x7f10b015def0 legacy=0x7f10b00b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b506c640 1 -- 172.21.15.113:0/2253800533 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00d27f0 con 0x7f10b00b2d80 2024-02-26T12:20:09.581 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.596+0000 7f10b486b640 1 -- 172.21.15.113:0/2253800533 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856766237 0 0) 0x7f10b00d1f50 con 0x7f10b015def0 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b506c640 1 --2- 172.21.15.113:0/2253800533 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b00b2d80 0x7f10b00d2ff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097d0 tx=0x7f10a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880eefc37904b01e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b486b640 1 -- 172.21.15.113:0/2253800533 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0034070 con 0x7f10b00b2d80 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b486b640 1 -- 172.21.15.113:0/2253800533 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0030610 con 0x7f10b00b2d80 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b486b640 1 -- 172.21.15.113:0/2253800533 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00309e0 con 0x7f10b00b2d80 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 -- 172.21.15.113:0/2253800533 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b00b2d80 msgr2=0x7f10b00d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/2253800533 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b00b2d80 0x7f10b00d2ff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f10a00097d0 tx=0x7f10a002b960 comp rx=0 tx=0).stop 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 -- 172.21.15.113:0/2253800533 shutdown_connections 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/2253800533 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b00b2d80 0x7f10b00d2ff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 -- 172.21.15.113:0/2253800533 >> 172.21.15.113:0/2253800533 conn(0x7f10b00728b0 msgr2=0x7f10b00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 -- 172.21.15.113:0/2253800533 shutdown_connections 2024-02-26T12:20:09.583 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.597+0000 7f10b7ad1640 1 -- 172.21.15.113:0/2253800533 wait complete. 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.598+0000 7f10b7ad1640 1 Processor -- start 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.598+0000 7f10b7ad1640 1 -- start start 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10b00b2d80 0x7f10b00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10b00d3530 0x7f10b015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00cf140 con 0x7f10b01513d0 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00cefc0 con 0x7f10b00d3530 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b7ad1640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00b6c10 con 0x7f10b00b2d80 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b606e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.586 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b606e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59336/0 (socket says 172.21.15.113:59336) 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b606e640 1 -- 172.21.15.113:0/1313326623 learned_addr learned my addr 172.21.15.113:0/1313326623 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b506c640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10b00d3530 0x7f10b015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.599+0000 7f10b586d640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10b00b2d80 0x7f10b00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 -- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10b00b2d80 msgr2=0x7f10b00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10b00b2d80 0x7f10b00c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 -- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10b00d3530 msgr2=0x7f10b015e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10b00d3530 0x7f10b015e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 -- 172.21.15.113:0/1313326623 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b015ef30 con 0x7f10b01513d0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b606e640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c7a0 tx=0x7f10ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac003b70 con 0x7f10b01513d0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac003d30 con 0x7f10b01513d0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b015f210 con 0x7f10b01513d0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00aa90 con 0x7f10b01513d0 2024-02-26T12:20:09.587 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.600+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b015f7d0 con 0x7f10b01513d0 2024-02-26T12:20:09.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.601+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b00ce0a0 con 0x7f10b01513d0 2024-02-26T12:20:09.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.601+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10ac00ac30 con 0x7f10b01513d0 2024-02-26T12:20:09.588 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.602+0000 7f10a67fc640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.602+0000 7f10b586d640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.602+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10ac08a0b0 con 0x7f10b01513d0 2024-02-26T12:20:09.589 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.602+0000 7f10b586d640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 0x7f109406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f10a8000f60 tx=0x7f10a8007d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.591 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.606+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10b00ce0a0 con 0x7f10b01513d0 2024-02-26T12:20:09.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.775+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10b0074a50 con 0x7f109406b4d0 2024-02-26T12:20:09.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.781+0000 7f10a67fc640 1 -- 172.21.15.113:0/1313326623 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246633 (secure 0 0 0) 0x7f10b0074a50 con 0x7f109406b4d0 2024-02-26T12:20:09.769 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:09.770 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 msgr2=0x7f109406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 0x7f109406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f10a8000f60 tx=0x7f10a8007d20 comp rx=0 tx=0).stop 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 msgr2=0x7f10b015fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c7a0 tx=0x7f10ac00cc60 comp rx=0 tx=0).stop 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 shutdown_connections 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f10b01513d0 0x7f10b015fdb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10b00d3530 0x7f10b015e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 --2- 172.21.15.113:0/1313326623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10b00b2d80 0x7f10b00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 >> 172.21.15.113:0/1313326623 conn(0x7f10b00728b0 msgr2=0x7f10b00b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 shutdown_connections 2024-02-26T12:20:09.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.784+0000 7f10b7ad1640 1 -- 172.21.15.113:0/1313326623 wait complete. 2024-02-26T12:20:09.780 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-26T12:20:09.164971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2099008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.347960"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841372+0000","last_change":"2024-02-26T12:20:05.841372+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841372+0000","last_undegraded":"2024-02-26T12:20:05.841372+0000","last_fullsized":"2024-02-26T12:20:05.841372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836173+0000","last_change":"2024-02-26T12:20:05.836173+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836173+0000","last_undegraded":"2024-02-26T12:20:05.836173+0000","last_fullsized":"2024-02-26T12:20:05.836173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831195+0000","last_change":"2024-02-26T12:20:05.831195+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831195+0000","last_undegraded":"2024-02-26T12:20:05.831195+0000","last_fullsized":"2024-02-26T12:20:05.831195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831490+0000","last_change":"2024-02-26T12:20:05.831490+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831490+0000","last_undegraded":"2024-02-26T12:20:05.831490+0000","last_fullsized":"2024-02-26T12:20:05.831490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829072+0000","last_change":"2024-02-26T12:20:05.829072+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829072+0000","last_undegraded":"2024-02-26T12:20:05.829072+0000","last_fullsized":"2024-02-26T12:20:05.829072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835654+0000","last_change":"2024-02-26T12:20:05.835654+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835654+0000","last_undegraded":"2024-02-26T12:20:05.835654+0000","last_fullsized":"2024-02-26T12:20:05.835654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831498+0000","last_change":"2024-02-26T12:20:05.831498+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831498+0000","last_undegraded":"2024-02-26T12:20:05.831498+0000","last_fullsized":"2024-02-26T12:20:05.831498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834583+0000","last_change":"2024-02-26T12:20:05.834583+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834583+0000","last_undegraded":"2024-02-26T12:20:05.834583+0000","last_fullsized":"2024-02-26T12:20:05.834583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837546+0000","last_change":"2024-02-26T12:20:05.837546+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837546+0000","last_undegraded":"2024-02-26T12:20:05.837546+0000","last_fullsized":"2024-02-26T12:20:05.837546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830063+0000","last_change":"2024-02-26T12:20:05.830063+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830063+0000","last_undegraded":"2024-02-26T12:20:05.830063+0000","last_fullsized":"2024-02-26T12:20:05.830063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832605+0000","last_change":"2024-02-26T12:20:05.832605+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832605+0000","last_undegraded":"2024-02-26T12:20:05.832605+0000","last_fullsized":"2024-02-26T12:20:05.832605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830264+0000","last_change":"2024-02-26T12:20:05.830264+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830264+0000","last_undegraded":"2024-02-26T12:20:05.830264+0000","last_fullsized":"2024-02-26T12:20:05.830264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.828596+0000","last_change":"2024-02-26T12:20:05.828596+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.828596+0000","last_undegraded":"2024-02-26T12:20:05.828596+0000","last_fullsized":"2024-02-26T12:20:05.828596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835160+0000","last_change":"2024-02-26T12:20:05.835160+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835160+0000","last_undegraded":"2024-02-26T12:20:05.835160+0000","last_fullsized":"2024-02-26T12:20:05.835160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829731+0000","last_change":"2024-02-26T12:20:05.829731+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829731+0000","last_undegraded":"2024-02-26T12:20:05.829731+0000","last_fullsized":"2024-02-26T12:20:05.829731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832579+0000","last_change":"2024-02-26T12:20:05.832579+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832579+0000","last_undegraded":"2024-02-26T12:20:05.832579+0000","last_fullsized":"2024-02-26T12:20:05.832579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832969+0000","last_change":"2024-02-26T12:20:05.832969+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832969+0000","last_undegraded":"2024-02-26T12:20:05.832969+0000","last_fullsized":"2024-02-26T12:20:05.832969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834789+0000","last_change":"2024-02-26T12:20:05.834789+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834789+0000","last_undegraded":"2024-02-26T12:20:05.834789+0000","last_fullsized":"2024-02-26T12:20:05.834789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834111+0000","last_change":"2024-02-26T12:20:05.834111+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834111+0000","last_undegraded":"2024-02-26T12:20:05.834111+0000","last_fullsized":"2024-02-26T12:20:05.834111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827705+0000","last_change":"2024-02-26T12:20:05.827705+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827705+0000","last_undegraded":"2024-02-26T12:20:05.827705+0000","last_fullsized":"2024-02-26T12:20:05.827705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836667+0000","last_change":"2024-02-26T12:20:05.836667+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836667+0000","last_undegraded":"2024-02-26T12:20:05.836667+0000","last_fullsized":"2024-02-26T12:20:05.836667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837226+0000","last_change":"2024-02-26T12:20:05.837226+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837226+0000","last_undegraded":"2024-02-26T12:20:05.837226+0000","last_fullsized":"2024-02-26T12:20:05.837226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829750+0000","last_change":"2024-02-26T12:20:05.829750+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829750+0000","last_undegraded":"2024-02-26T12:20:05.829750+0000","last_fullsized":"2024-02-26T12:20:05.829750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830909+0000","last_change":"2024-02-26T12:20:05.830909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830909+0000","last_undegraded":"2024-02-26T12:20:05.830909+0000","last_fullsized":"2024-02-26T12:20:05.830909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830804+0000","last_change":"2024-02-26T12:20:05.830804+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830804+0000","last_undegraded":"2024-02-26T12:20:05.830804+0000","last_fullsized":"2024-02-26T12:20:05.830804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832562+0000","last_change":"2024-02-26T12:20:05.832562+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832562+0000","last_undegraded":"2024-02-26T12:20:05.832562+0000","last_fullsized":"2024-02-26T12:20:05.832562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830995+0000","last_change":"2024-02-26T12:20:05.830995+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830995+0000","last_undegraded":"2024-02-26T12:20:05.830995+0000","last_fullsized":"2024-02-26T12:20:05.830995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829695+0000","last_change":"2024-02-26T12:20:05.829695+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829695+0000","last_undegraded":"2024-02-26T12:20:05.829695+0000","last_fullsized":"2024-02-26T12:20:05.829695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833441+0000","last_change":"2024-02-26T12:20:05.833441+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833441+0000","last_undegraded":"2024-02-26T12:20:05.833441+0000","last_fullsized":"2024-02-26T12:20:05.833441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833291+0000","last_change":"2024-02-26T12:20:05.833291+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833291+0000","last_undegraded":"2024-02-26T12:20:05.833291+0000","last_fullsized":"2024-02-26T12:20:05.833291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840768+0000","last_change":"2024-02-26T12:20:05.840768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840768+0000","last_undegraded":"2024-02-26T12:20:05.840768+0000","last_fullsized":"2024-02-26T12:20:05.840768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834216+0000","last_change":"2024-02-26T12:20:05.834216+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834216+0000","last_undegraded":"2024-02-26T12:20:05.834216+0000","last_fullsized":"2024-02-26T12:20:05.834216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831676+0000","last_change":"2024-02-26T12:20:05.831676+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831676+0000","last_undegraded":"2024-02-26T12:20:05.831676+0000","last_fullsized":"2024-02-26T12:20:05.831676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853515+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:05.853515+0000","last_peered":"2024-02-26T12:20:05.853515+0000","last_clean":"2024-02-26T12:20:05.853515+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:05.853515+0000","last_undegraded":"2024-02-26T12:20:05.853515+0000","last_fullsized":"2024-02-26T12:20:05.853515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840915+0000","last_change":"2024-02-26T12:20:05.840915+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840915+0000","last_undegraded":"2024-02-26T12:20:05.840915+0000","last_fullsized":"2024-02-26T12:20:05.840915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842580+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:05.842580+0000","last_peered":"2024-02-26T12:20:05.842580+0000","last_clean":"2024-02-26T12:20:05.842580+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:05.842580+0000","last_undegraded":"2024-02-26T12:20:05.842580+0000","last_fullsized":"2024-02-26T12:20:05.842580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832713+0000","last_change":"2024-02-26T12:20:05.832713+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832713+0000","last_undegraded":"2024-02-26T12:20:05.832713+0000","last_fullsized":"2024-02-26T12:20:05.832713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847008+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:05.847008+0000","last_peered":"2024-02-26T12:20:05.847008+0000","last_clean":"2024-02-26T12:20:05.847008+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:05.847008+0000","last_undegraded":"2024-02-26T12:20:05.847008+0000","last_fullsized":"2024-02-26T12:20:05.847008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:18.597490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830544+0000","last_change":"2024-02-26T12:20:05.830544+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830544+0000","last_undegraded":"2024-02-26T12:20:05.830544+0000","last_fullsized":"2024-02-26T12:20:05.830544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.836818+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:05.836818+0000","last_peered":"2024-02-26T12:20:05.836818+0000","last_clean":"2024-02-26T12:20:05.836818+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:05.836818+0000","last_undegraded":"2024-02-26T12:20:05.836818+0000","last_fullsized":"2024-02-26T12:20:05.836818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:04:45.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832187+0000","last_change":"2024-02-26T12:20:05.832187+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832187+0000","last_undegraded":"2024-02-26T12:20:05.832187+0000","last_fullsized":"2024-02-26T12:20:05.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850688+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:05.850688+0000","last_peered":"2024-02-26T12:20:05.850688+0000","last_clean":"2024-02-26T12:20:05.850688+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:05.850688+0000","last_undegraded":"2024-02-26T12:20:05.850688+0000","last_fullsized":"2024-02-26T12:20:05.850688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830148+0000","last_change":"2024-02-26T12:20:05.830148+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830148+0000","last_undegraded":"2024-02-26T12:20:05.830148+0000","last_fullsized":"2024-02-26T12:20:05.830148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850629+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:05.850629+0000","last_peered":"2024-02-26T12:20:05.850629+0000","last_clean":"2024-02-26T12:20:05.850629+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:05.850629+0000","last_undegraded":"2024-02-26T12:20:05.850629+0000","last_fullsized":"2024-02-26T12:20:05.850629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:52.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831907+0000","last_change":"2024-02-26T12:20:05.831907+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831907+0000","last_undegraded":"2024-02-26T12:20:05.831907+0000","last_fullsized":"2024-02-26T12:20:05.831907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846780+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:05.846780+0000","last_peered":"2024-02-26T12:20:05.846780+0000","last_clean":"2024-02-26T12:20:05.846780+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:05.846780+0000","last_undegraded":"2024-02-26T12:20:05.846780+0000","last_fullsized":"2024-02-26T12:20:05.846780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829406+0000","last_change":"2024-02-26T12:20:05.829406+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829406+0000","last_undegraded":"2024-02-26T12:20:05.829406+0000","last_fullsized":"2024-02-26T12:20:05.829406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847997+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:05.847997+0000","last_peered":"2024-02-26T12:20:05.847997+0000","last_clean":"2024-02-26T12:20:05.847997+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:05.847997+0000","last_undegraded":"2024-02-26T12:20:05.847997+0000","last_fullsized":"2024-02-26T12:20:05.847997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:56.431417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830665+0000","last_change":"2024-02-26T12:20:05.830665+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830665+0000","last_undegraded":"2024-02-26T12:20:05.830665+0000","last_fullsized":"2024-02-26T12:20:05.830665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847012+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:05.847012+0000","last_peered":"2024-02-26T12:20:05.847012+0000","last_clean":"2024-02-26T12:20:05.847012+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:05.847012+0000","last_undegraded":"2024-02-26T12:20:05.847012+0000","last_fullsized":"2024-02-26T12:20:05.847012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832039+0000","last_change":"2024-02-26T12:20:05.832039+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832039+0000","last_undegraded":"2024-02-26T12:20:05.832039+0000","last_fullsized":"2024-02-26T12:20:05.832039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846632+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:05.846632+0000","last_peered":"2024-02-26T12:20:05.846632+0000","last_clean":"2024-02-26T12:20:05.846632+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:05.846632+0000","last_undegraded":"2024-02-26T12:20:05.846632+0000","last_fullsized":"2024-02-26T12:20:05.846632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831589+0000","last_change":"2024-02-26T12:20:05.831589+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831589+0000","last_undegraded":"2024-02-26T12:20:05.831589+0000","last_fullsized":"2024-02-26T12:20:05.831589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842364+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:05.842364+0000","last_peered":"2024-02-26T12:20:05.842364+0000","last_clean":"2024-02-26T12:20:05.842364+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:05.842364+0000","last_undegraded":"2024-02-26T12:20:05.842364+0000","last_fullsized":"2024-02-26T12:20:05.842364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832126+0000","last_change":"2024-02-26T12:20:05.832126+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832126+0000","last_undegraded":"2024-02-26T12:20:05.832126+0000","last_fullsized":"2024-02-26T12:20:05.832126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849225+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:05.849225+0000","last_peered":"2024-02-26T12:20:05.849225+0000","last_clean":"2024-02-26T12:20:05.849225+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:05.849225+0000","last_undegraded":"2024-02-26T12:20:05.849225+0000","last_fullsized":"2024-02-26T12:20:05.849225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:45.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829895+0000","last_change":"2024-02-26T12:20:05.829895+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829895+0000","last_undegraded":"2024-02-26T12:20:05.829895+0000","last_fullsized":"2024-02-26T12:20:05.829895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850665+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:05.850665+0000","last_peered":"2024-02-26T12:20:05.850665+0000","last_clean":"2024-02-26T12:20:05.850665+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:05.850665+0000","last_undegraded":"2024-02-26T12:20:05.850665+0000","last_fullsized":"2024-02-26T12:20:05.850665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:34:09.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829768+0000","last_change":"2024-02-26T12:20:05.829768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829768+0000","last_undegraded":"2024-02-26T12:20:05.829768+0000","last_fullsized":"2024-02-26T12:20:05.829768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849361+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:05.849361+0000","last_peered":"2024-02-26T12:20:05.849361+0000","last_clean":"2024-02-26T12:20:05.849361+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:05.849361+0000","last_undegraded":"2024-02-26T12:20:05.849361+0000","last_fullsized":"2024-02-26T12:20:05.849361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833818+0000","last_change":"2024-02-26T12:20:05.833818+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833818+0000","last_undegraded":"2024-02-26T12:20:05.833818+0000","last_fullsized":"2024-02-26T12:20:05.833818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847020+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:05.847020+0000","last_peered":"2024-02-26T12:20:05.847020+0000","last_clean":"2024-02-26T12:20:05.847020+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:05.847020+0000","last_undegraded":"2024-02-26T12:20:05.847020+0000","last_fullsized":"2024-02-26T12:20:05.847020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840293+0000","last_change":"2024-02-26T12:20:05.840293+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840293+0000","last_undegraded":"2024-02-26T12:20:05.840293+0000","last_fullsized":"2024-02-26T12:20:05.840293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846969+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:05.846969+0000","last_peered":"2024-02-26T12:20:05.846969+0000","last_clean":"2024-02-26T12:20:05.846969+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:05.846969+0000","last_undegraded":"2024-02-26T12:20:05.846969+0000","last_fullsized":"2024-02-26T12:20:05.846969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832475+0000","last_change":"2024-02-26T12:20:05.832475+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832475+0000","last_undegraded":"2024-02-26T12:20:05.832475+0000","last_fullsized":"2024-02-26T12:20:05.832475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849364+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:05.849364+0000","last_peered":"2024-02-26T12:20:05.849364+0000","last_clean":"2024-02-26T12:20:05.849364+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:05.849364+0000","last_undegraded":"2024-02-26T12:20:05.849364+0000","last_fullsized":"2024-02-26T12:20:05.849364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834094+0000","last_change":"2024-02-26T12:20:05.834094+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834094+0000","last_undegraded":"2024-02-26T12:20:05.834094+0000","last_fullsized":"2024-02-26T12:20:05.834094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850673+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:05.850673+0000","last_peered":"2024-02-26T12:20:05.850673+0000","last_clean":"2024-02-26T12:20:05.850673+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:05.850673+0000","last_undegraded":"2024-02-26T12:20:05.850673+0000","last_fullsized":"2024-02-26T12:20:05.850673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:36.730929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830976+0000","last_change":"2024-02-26T12:20:05.830976+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830976+0000","last_undegraded":"2024-02-26T12:20:05.830976+0000","last_fullsized":"2024-02-26T12:20:05.830976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842241+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:05.842241+0000","last_peered":"2024-02-26T12:20:05.842241+0000","last_clean":"2024-02-26T12:20:05.842241+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:05.842241+0000","last_undegraded":"2024-02-26T12:20:05.842241+0000","last_fullsized":"2024-02-26T12:20:05.842241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:48:24.285490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827649+0000","last_change":"2024-02-26T12:20:05.827649+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827649+0000","last_undegraded":"2024-02-26T12:20:05.827649+0000","last_fullsized":"2024-02-26T12:20:05.827649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850631+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:05.850631+0000","last_peered":"2024-02-26T12:20:05.850631+0000","last_clean":"2024-02-26T12:20:05.850631+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:05.850631+0000","last_undegraded":"2024-02-26T12:20:05.850631+0000","last_fullsized":"2024-02-26T12:20:05.850631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:12:09.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827537+0000","last_change":"2024-02-26T12:20:05.827537+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827537+0000","last_undegraded":"2024-02-26T12:20:05.827537+0000","last_fullsized":"2024-02-26T12:20:05.827537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841315+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:05.841315+0000","last_peered":"2024-02-26T12:20:05.841315+0000","last_clean":"2024-02-26T12:20:05.841315+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:05.841315+0000","last_undegraded":"2024-02-26T12:20:05.841315+0000","last_fullsized":"2024-02-26T12:20:05.841315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827627+0000","last_change":"2024-02-26T12:20:05.827627+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827627+0000","last_undegraded":"2024-02-26T12:20:05.827627+0000","last_fullsized":"2024-02-26T12:20:05.827627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853229+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:05.853229+0000","last_peered":"2024-02-26T12:20:05.853229+0000","last_clean":"2024-02-26T12:20:05.853229+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:05.853229+0000","last_undegraded":"2024-02-26T12:20:05.853229+0000","last_fullsized":"2024-02-26T12:20:05.853229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827473+0000","last_change":"2024-02-26T12:20:05.827473+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827473+0000","last_undegraded":"2024-02-26T12:20:05.827473+0000","last_fullsized":"2024-02-26T12:20:05.827473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847870+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:05.847870+0000","last_peered":"2024-02-26T12:20:05.847870+0000","last_clean":"2024-02-26T12:20:05.847870+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:05.847870+0000","last_undegraded":"2024-02-26T12:20:05.847870+0000","last_fullsized":"2024-02-26T12:20:05.847870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:23:03.235433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831987+0000","last_change":"2024-02-26T12:20:05.831987+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831987+0000","last_undegraded":"2024-02-26T12:20:05.831987+0000","last_fullsized":"2024-02-26T12:20:05.831987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842326+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:05.842326+0000","last_peered":"2024-02-26T12:20:05.842326+0000","last_clean":"2024-02-26T12:20:05.842326+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:05.842326+0000","last_undegraded":"2024-02-26T12:20:05.842326+0000","last_fullsized":"2024-02-26T12:20:05.842326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827709+0000","last_change":"2024-02-26T12:20:05.827709+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827709+0000","last_undegraded":"2024-02-26T12:20:05.827709+0000","last_fullsized":"2024-02-26T12:20:05.827709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842659+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:05.842659+0000","last_peered":"2024-02-26T12:20:05.842659+0000","last_clean":"2024-02-26T12:20:05.842659+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:05.842659+0000","last_undegraded":"2024-02-26T12:20:05.842659+0000","last_fullsized":"2024-02-26T12:20:05.842659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831540+0000","last_change":"2024-02-26T12:20:05.831540+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831540+0000","last_undegraded":"2024-02-26T12:20:05.831540+0000","last_fullsized":"2024-02-26T12:20:05.831540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841264+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:05.841264+0000","last_peered":"2024-02-26T12:20:05.841264+0000","last_clean":"2024-02-26T12:20:05.841264+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:05.841264+0000","last_undegraded":"2024-02-26T12:20:05.841264+0000","last_fullsized":"2024-02-26T12:20:05.841264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829278+0000","last_change":"2024-02-26T12:20:05.829278+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829278+0000","last_undegraded":"2024-02-26T12:20:05.829278+0000","last_fullsized":"2024-02-26T12:20:05.829278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.844294+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:05.844294+0000","last_peered":"2024-02-26T12:20:05.844294+0000","last_clean":"2024-02-26T12:20:05.844294+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:05.844294+0000","last_undegraded":"2024-02-26T12:20:05.844294+0000","last_fullsized":"2024-02-26T12:20:05.844294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841213+0000","last_change":"2024-02-26T12:20:05.841213+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841213+0000","last_undegraded":"2024-02-26T12:20:05.841213+0000","last_fullsized":"2024-02-26T12:20:05.841213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841295+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:05.841295+0000","last_peered":"2024-02-26T12:20:05.841295+0000","last_clean":"2024-02-26T12:20:05.841295+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:05.841295+0000","last_undegraded":"2024-02-26T12:20:05.841295+0000","last_fullsized":"2024-02-26T12:20:05.841295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830435+0000","last_change":"2024-02-26T12:20:05.830435+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830435+0000","last_undegraded":"2024-02-26T12:20:05.830435+0000","last_fullsized":"2024-02-26T12:20:05.830435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.843379+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:05.843379+0000","last_peered":"2024-02-26T12:20:05.843379+0000","last_clean":"2024-02-26T12:20:05.843379+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:05.843379+0000","last_undegraded":"2024-02-26T12:20:05.843379+0000","last_fullsized":"2024-02-26T12:20:05.843379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829222+0000","last_change":"2024-02-26T12:20:05.829222+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829222+0000","last_undegraded":"2024-02-26T12:20:05.829222+0000","last_fullsized":"2024-02-26T12:20:05.829222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842231+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:05.842231+0000","last_peered":"2024-02-26T12:20:05.842231+0000","last_clean":"2024-02-26T12:20:05.842231+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:05.842231+0000","last_undegraded":"2024-02-26T12:20:05.842231+0000","last_fullsized":"2024-02-26T12:20:05.842231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:27:33.383673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833026+0000","last_change":"2024-02-26T12:20:05.833026+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833026+0000","last_undegraded":"2024-02-26T12:20:05.833026+0000","last_fullsized":"2024-02-26T12:20:05.833026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846928+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:05.846928+0000","last_peered":"2024-02-26T12:20:05.846928+0000","last_clean":"2024-02-26T12:20:05.846928+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:05.846928+0000","last_undegraded":"2024-02-26T12:20:05.846928+0000","last_fullsized":"2024-02-26T12:20:05.846928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832909+0000","last_change":"2024-02-26T12:20:05.832909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832909+0000","last_undegraded":"2024-02-26T12:20:05.832909+0000","last_fullsized":"2024-02-26T12:20:05.832909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853513+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:05.853513+0000","last_peered":"2024-02-26T12:20:05.853513+0000","last_clean":"2024-02-26T12:20:05.853513+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:05.853513+0000","last_undegraded":"2024-02-26T12:20:05.853513+0000","last_fullsized":"2024-02-26T12:20:05.853513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.834753+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:05.834753+0000","last_peered":"2024-02-26T12:20:05.834753+0000","last_clean":"2024-02-26T12:20:05.834753+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:05.834753+0000","last_undegraded":"2024-02-26T12:20:05.834753+0000","last_fullsized":"2024-02-26T12:20:05.834753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:09.784 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:09.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.935+0000 7f3a2a0de640 1 Processor -- start 2024-02-26T12:20:09.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.935+0000 7f3a2a0de640 1 -- start start 2024-02-26T12:20:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a2a0de640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a2415bb50 0x7f3a240716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.922 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a2a0de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240d0d00 0x7f3a240cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a2a0de640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a24071bf0 con 0x7f3a240b3350 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a2a0de640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a24070c60 con 0x7f3a2415bb50 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a2a0de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240cc5f0 con 0x7f3a240d0d00 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a237fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a2415bb50 0x7f3a240716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a23fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3a240b3350 0x7f3a240cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47620/0 (socket says 172.21.15.113:47620) 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a23fff640 1 -- 172.21.15.113:0/2072868695 learned_addr learned my addr 172.21.15.113:0/2072868695 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a22ffd640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240d0d00 0x7f3a240cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a237fe640 1 -- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240d0d00 msgr2=0x7f3a240cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a237fe640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240d0d00 0x7f3a240cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a237fe640 1 -- 172.21.15.113:0/2072868695 >> v1:172.21.15.152:6789/0 conn(0x7f3a240b3350 legacy=0x7f3a240cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a237fe640 1 -- 172.21.15.113:0/2072868695 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240cc8a0 con 0x7f3a2415bb50 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.936+0000 7f3a227fc640 1 -- 172.21.15.113:0/2072868695 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152319004 0 0) 0x7f3a24071bf0 con 0x7f3a240b3350 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.937+0000 7f3a237fe640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240716b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097d0 tx=0x7f3a1402b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7201c07059fcef35 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.937+0000 7f3a227fc640 1 -- 172.21.15.113:0/2072868695 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14031770 con 0x7f3a2415bb50 2024-02-26T12:20:09.923 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.937+0000 7f3a227fc640 1 -- 172.21.15.113:0/2072868695 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a14037070 con 0x7f3a2415bb50 2024-02-26T12:20:09.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.937+0000 7f3a227fc640 1 -- 172.21.15.113:0/2072868695 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14031b30 con 0x7f3a2415bb50 2024-02-26T12:20:09.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 -- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 msgr2=0x7f3a240716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.926 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240716b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097d0 tx=0x7f3a1402b810 comp rx=0 tx=0).stop 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 -- 172.21.15.113:0/2072868695 shutdown_connections 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240d0d00 0x7f3a240cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/2072868695 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240716b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 -- 172.21.15.113:0/2072868695 >> 172.21.15.113:0/2072868695 conn(0x7f3a240ce350 msgr2=0x7f3a240ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 -- 172.21.15.113:0/2072868695 shutdown_connections 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.938+0000 7f3a2a0de640 1 -- 172.21.15.113:0/2072868695 wait complete. 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.939+0000 7f3a2a0de640 1 Processor -- start 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.939+0000 7f3a2a0de640 1 -- start start 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 0x7f3a240c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.927 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24071190 con 0x7f3a240d0d00 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24070eb0 con 0x7f3a2415bb50 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a2a0de640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2415bf30 con 0x7f3a240b3350 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a22ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a22ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59348/0 (socket says 172.21.15.113:59348) 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a22ffd640 1 -- 172.21.15.113:0/3382283635 learned_addr learned my addr 172.21.15.113:0/3382283635 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a23fff640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a237fe640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 0x7f3a240c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.940+0000 7f3a22ffd640 1 -- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 msgr2=0x7f3a240c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a22ffd640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 0x7f3a240c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a22ffd640 1 -- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 msgr2=0x7f3a240b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a22ffd640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:09.928 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a22ffd640 1 -- 172.21.15.113:0/3382283635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240c8a40 con 0x7f3a240d0d00 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a237fe640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 0x7f3a240c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a22ffd640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e9b0 tx=0x7f3a1800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18017070 con 0x7f3a240d0d00 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800c9a0 con 0x7f3a240d0d00 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a240c99f0 con 0x7f3a240d0d00 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800cd90 con 0x7f3a240d0d00 2024-02-26T12:20:09.929 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.941+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a240c8cb0 con 0x7f3a240d0d00 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.942+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a24074a50 con 0x7f3a240d0d00 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.942+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a1801a070 con 0x7f3a240d0d00 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.943+0000 7f3a0bfff640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 0x7f3a1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.943+0000 7f3a237fe640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 0x7f3a1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.943+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a1808a190 con 0x7f3a240d0d00 2024-02-26T12:20:09.930 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.943+0000 7f3a237fe640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 0x7f3a1006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a1403d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:09.932 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:09.947+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a180589c0 con 0x7f3a240d0d00 2024-02-26T12:20:10.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.115+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a240cf240 con 0x7f3a1006b4d0 2024-02-26T12:20:10.106 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.121+0000 7f3a0bfff640 1 -- 172.21.15.113:0/3382283635 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246633 (secure 0 0 0) 0x7f3a240cf240 con 0x7f3a1006b4d0 2024-02-26T12:20:10.109 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:10.110 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:10.111 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 msgr2=0x7f3a1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 0x7f3a1006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a14036000 tx=0x7f3a1403d040 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 msgr2=0x7f3a240b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800e9b0 tx=0x7f3a1800ee70 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 shutdown_connections 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3a1006b4d0 0x7f3a1006d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a2415bb50 0x7f3a240b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a240d0d00 0x7f3a240b5900 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 --2- 172.21.15.113:0/3382283635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a240b3350 0x7f3a240c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 >> 172.21.15.113:0/3382283635 conn(0x7f3a240ce350 msgr2=0x7f3a24159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 shutdown_connections 2024-02-26T12:20:10.112 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.124+0000 7f3a2a0de640 1 -- 172.21.15.113:0/3382283635 wait complete. 2024-02-26T12:20:10.120 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-26T12:20:09.164971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2099008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.347960"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841372+0000","last_change":"2024-02-26T12:20:05.841372+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841372+0000","last_undegraded":"2024-02-26T12:20:05.841372+0000","last_fullsized":"2024-02-26T12:20:05.841372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836173+0000","last_change":"2024-02-26T12:20:05.836173+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836173+0000","last_undegraded":"2024-02-26T12:20:05.836173+0000","last_fullsized":"2024-02-26T12:20:05.836173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831195+0000","last_change":"2024-02-26T12:20:05.831195+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831195+0000","last_undegraded":"2024-02-26T12:20:05.831195+0000","last_fullsized":"2024-02-26T12:20:05.831195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831490+0000","last_change":"2024-02-26T12:20:05.831490+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831490+0000","last_undegraded":"2024-02-26T12:20:05.831490+0000","last_fullsized":"2024-02-26T12:20:05.831490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829072+0000","last_change":"2024-02-26T12:20:05.829072+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829072+0000","last_undegraded":"2024-02-26T12:20:05.829072+0000","last_fullsized":"2024-02-26T12:20:05.829072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835654+0000","last_change":"2024-02-26T12:20:05.835654+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835654+0000","last_undegraded":"2024-02-26T12:20:05.835654+0000","last_fullsized":"2024-02-26T12:20:05.835654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831498+0000","last_change":"2024-02-26T12:20:05.831498+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831498+0000","last_undegraded":"2024-02-26T12:20:05.831498+0000","last_fullsized":"2024-02-26T12:20:05.831498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834583+0000","last_change":"2024-02-26T12:20:05.834583+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834583+0000","last_undegraded":"2024-02-26T12:20:05.834583+0000","last_fullsized":"2024-02-26T12:20:05.834583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837546+0000","last_change":"2024-02-26T12:20:05.837546+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837546+0000","last_undegraded":"2024-02-26T12:20:05.837546+0000","last_fullsized":"2024-02-26T12:20:05.837546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830063+0000","last_change":"2024-02-26T12:20:05.830063+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830063+0000","last_undegraded":"2024-02-26T12:20:05.830063+0000","last_fullsized":"2024-02-26T12:20:05.830063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832605+0000","last_change":"2024-02-26T12:20:05.832605+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832605+0000","last_undegraded":"2024-02-26T12:20:05.832605+0000","last_fullsized":"2024-02-26T12:20:05.832605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830264+0000","last_change":"2024-02-26T12:20:05.830264+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830264+0000","last_undegraded":"2024-02-26T12:20:05.830264+0000","last_fullsized":"2024-02-26T12:20:05.830264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.828596+0000","last_change":"2024-02-26T12:20:05.828596+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.828596+0000","last_undegraded":"2024-02-26T12:20:05.828596+0000","last_fullsized":"2024-02-26T12:20:05.828596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835160+0000","last_change":"2024-02-26T12:20:05.835160+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835160+0000","last_undegraded":"2024-02-26T12:20:05.835160+0000","last_fullsized":"2024-02-26T12:20:05.835160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829731+0000","last_change":"2024-02-26T12:20:05.829731+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829731+0000","last_undegraded":"2024-02-26T12:20:05.829731+0000","last_fullsized":"2024-02-26T12:20:05.829731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832579+0000","last_change":"2024-02-26T12:20:05.832579+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832579+0000","last_undegraded":"2024-02-26T12:20:05.832579+0000","last_fullsized":"2024-02-26T12:20:05.832579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832969+0000","last_change":"2024-02-26T12:20:05.832969+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832969+0000","last_undegraded":"2024-02-26T12:20:05.832969+0000","last_fullsized":"2024-02-26T12:20:05.832969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834789+0000","last_change":"2024-02-26T12:20:05.834789+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834789+0000","last_undegraded":"2024-02-26T12:20:05.834789+0000","last_fullsized":"2024-02-26T12:20:05.834789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834111+0000","last_change":"2024-02-26T12:20:05.834111+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834111+0000","last_undegraded":"2024-02-26T12:20:05.834111+0000","last_fullsized":"2024-02-26T12:20:05.834111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827705+0000","last_change":"2024-02-26T12:20:05.827705+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827705+0000","last_undegraded":"2024-02-26T12:20:05.827705+0000","last_fullsized":"2024-02-26T12:20:05.827705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836667+0000","last_change":"2024-02-26T12:20:05.836667+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836667+0000","last_undegraded":"2024-02-26T12:20:05.836667+0000","last_fullsized":"2024-02-26T12:20:05.836667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837226+0000","last_change":"2024-02-26T12:20:05.837226+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837226+0000","last_undegraded":"2024-02-26T12:20:05.837226+0000","last_fullsized":"2024-02-26T12:20:05.837226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829750+0000","last_change":"2024-02-26T12:20:05.829750+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829750+0000","last_undegraded":"2024-02-26T12:20:05.829750+0000","last_fullsized":"2024-02-26T12:20:05.829750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830909+0000","last_change":"2024-02-26T12:20:05.830909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830909+0000","last_undegraded":"2024-02-26T12:20:05.830909+0000","last_fullsized":"2024-02-26T12:20:05.830909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830804+0000","last_change":"2024-02-26T12:20:05.830804+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830804+0000","last_undegraded":"2024-02-26T12:20:05.830804+0000","last_fullsized":"2024-02-26T12:20:05.830804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832562+0000","last_change":"2024-02-26T12:20:05.832562+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832562+0000","last_undegraded":"2024-02-26T12:20:05.832562+0000","last_fullsized":"2024-02-26T12:20:05.832562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830995+0000","last_change":"2024-02-26T12:20:05.830995+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830995+0000","last_undegraded":"2024-02-26T12:20:05.830995+0000","last_fullsized":"2024-02-26T12:20:05.830995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829695+0000","last_change":"2024-02-26T12:20:05.829695+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829695+0000","last_undegraded":"2024-02-26T12:20:05.829695+0000","last_fullsized":"2024-02-26T12:20:05.829695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833441+0000","last_change":"2024-02-26T12:20:05.833441+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833441+0000","last_undegraded":"2024-02-26T12:20:05.833441+0000","last_fullsized":"2024-02-26T12:20:05.833441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833291+0000","last_change":"2024-02-26T12:20:05.833291+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833291+0000","last_undegraded":"2024-02-26T12:20:05.833291+0000","last_fullsized":"2024-02-26T12:20:05.833291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840768+0000","last_change":"2024-02-26T12:20:05.840768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840768+0000","last_undegraded":"2024-02-26T12:20:05.840768+0000","last_fullsized":"2024-02-26T12:20:05.840768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834216+0000","last_change":"2024-02-26T12:20:05.834216+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834216+0000","last_undegraded":"2024-02-26T12:20:05.834216+0000","last_fullsized":"2024-02-26T12:20:05.834216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831676+0000","last_change":"2024-02-26T12:20:05.831676+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831676+0000","last_undegraded":"2024-02-26T12:20:05.831676+0000","last_fullsized":"2024-02-26T12:20:05.831676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853515+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:05.853515+0000","last_peered":"2024-02-26T12:20:05.853515+0000","last_clean":"2024-02-26T12:20:05.853515+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:05.853515+0000","last_undegraded":"2024-02-26T12:20:05.853515+0000","last_fullsized":"2024-02-26T12:20:05.853515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840915+0000","last_change":"2024-02-26T12:20:05.840915+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840915+0000","last_undegraded":"2024-02-26T12:20:05.840915+0000","last_fullsized":"2024-02-26T12:20:05.840915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842580+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:05.842580+0000","last_peered":"2024-02-26T12:20:05.842580+0000","last_clean":"2024-02-26T12:20:05.842580+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:05.842580+0000","last_undegraded":"2024-02-26T12:20:05.842580+0000","last_fullsized":"2024-02-26T12:20:05.842580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832713+0000","last_change":"2024-02-26T12:20:05.832713+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832713+0000","last_undegraded":"2024-02-26T12:20:05.832713+0000","last_fullsized":"2024-02-26T12:20:05.832713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847008+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:05.847008+0000","last_peered":"2024-02-26T12:20:05.847008+0000","last_clean":"2024-02-26T12:20:05.847008+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:05.847008+0000","last_undegraded":"2024-02-26T12:20:05.847008+0000","last_fullsized":"2024-02-26T12:20:05.847008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:18.597490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830544+0000","last_change":"2024-02-26T12:20:05.830544+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830544+0000","last_undegraded":"2024-02-26T12:20:05.830544+0000","last_fullsized":"2024-02-26T12:20:05.830544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.836818+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:05.836818+0000","last_peered":"2024-02-26T12:20:05.836818+0000","last_clean":"2024-02-26T12:20:05.836818+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:05.836818+0000","last_undegraded":"2024-02-26T12:20:05.836818+0000","last_fullsized":"2024-02-26T12:20:05.836818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:04:45.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832187+0000","last_change":"2024-02-26T12:20:05.832187+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832187+0000","last_undegraded":"2024-02-26T12:20:05.832187+0000","last_fullsized":"2024-02-26T12:20:05.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850688+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:05.850688+0000","last_peered":"2024-02-26T12:20:05.850688+0000","last_clean":"2024-02-26T12:20:05.850688+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:05.850688+0000","last_undegraded":"2024-02-26T12:20:05.850688+0000","last_fullsized":"2024-02-26T12:20:05.850688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830148+0000","last_change":"2024-02-26T12:20:05.830148+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830148+0000","last_undegraded":"2024-02-26T12:20:05.830148+0000","last_fullsized":"2024-02-26T12:20:05.830148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850629+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:05.850629+0000","last_peered":"2024-02-26T12:20:05.850629+0000","last_clean":"2024-02-26T12:20:05.850629+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:05.850629+0000","last_undegraded":"2024-02-26T12:20:05.850629+0000","last_fullsized":"2024-02-26T12:20:05.850629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:52.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831907+0000","last_change":"2024-02-26T12:20:05.831907+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831907+0000","last_undegraded":"2024-02-26T12:20:05.831907+0000","last_fullsized":"2024-02-26T12:20:05.831907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846780+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:05.846780+0000","last_peered":"2024-02-26T12:20:05.846780+0000","last_clean":"2024-02-26T12:20:05.846780+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:05.846780+0000","last_undegraded":"2024-02-26T12:20:05.846780+0000","last_fullsized":"2024-02-26T12:20:05.846780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829406+0000","last_change":"2024-02-26T12:20:05.829406+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829406+0000","last_undegraded":"2024-02-26T12:20:05.829406+0000","last_fullsized":"2024-02-26T12:20:05.829406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847997+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:05.847997+0000","last_peered":"2024-02-26T12:20:05.847997+0000","last_clean":"2024-02-26T12:20:05.847997+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:05.847997+0000","last_undegraded":"2024-02-26T12:20:05.847997+0000","last_fullsized":"2024-02-26T12:20:05.847997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:56.431417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830665+0000","last_change":"2024-02-26T12:20:05.830665+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830665+0000","last_undegraded":"2024-02-26T12:20:05.830665+0000","last_fullsized":"2024-02-26T12:20:05.830665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847012+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:05.847012+0000","last_peered":"2024-02-26T12:20:05.847012+0000","last_clean":"2024-02-26T12:20:05.847012+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:05.847012+0000","last_undegraded":"2024-02-26T12:20:05.847012+0000","last_fullsized":"2024-02-26T12:20:05.847012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832039+0000","last_change":"2024-02-26T12:20:05.832039+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832039+0000","last_undegraded":"2024-02-26T12:20:05.832039+0000","last_fullsized":"2024-02-26T12:20:05.832039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846632+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:05.846632+0000","last_peered":"2024-02-26T12:20:05.846632+0000","last_clean":"2024-02-26T12:20:05.846632+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:05.846632+0000","last_undegraded":"2024-02-26T12:20:05.846632+0000","last_fullsized":"2024-02-26T12:20:05.846632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831589+0000","last_change":"2024-02-26T12:20:05.831589+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831589+0000","last_undegraded":"2024-02-26T12:20:05.831589+0000","last_fullsized":"2024-02-26T12:20:05.831589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842364+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:05.842364+0000","last_peered":"2024-02-26T12:20:05.842364+0000","last_clean":"2024-02-26T12:20:05.842364+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:05.842364+0000","last_undegraded":"2024-02-26T12:20:05.842364+0000","last_fullsized":"2024-02-26T12:20:05.842364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832126+0000","last_change":"2024-02-26T12:20:05.832126+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832126+0000","last_undegraded":"2024-02-26T12:20:05.832126+0000","last_fullsized":"2024-02-26T12:20:05.832126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849225+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:05.849225+0000","last_peered":"2024-02-26T12:20:05.849225+0000","last_clean":"2024-02-26T12:20:05.849225+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:05.849225+0000","last_undegraded":"2024-02-26T12:20:05.849225+0000","last_fullsized":"2024-02-26T12:20:05.849225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:45.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829895+0000","last_change":"2024-02-26T12:20:05.829895+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829895+0000","last_undegraded":"2024-02-26T12:20:05.829895+0000","last_fullsized":"2024-02-26T12:20:05.829895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850665+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:05.850665+0000","last_peered":"2024-02-26T12:20:05.850665+0000","last_clean":"2024-02-26T12:20:05.850665+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:05.850665+0000","last_undegraded":"2024-02-26T12:20:05.850665+0000","last_fullsized":"2024-02-26T12:20:05.850665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:34:09.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829768+0000","last_change":"2024-02-26T12:20:05.829768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829768+0000","last_undegraded":"2024-02-26T12:20:05.829768+0000","last_fullsized":"2024-02-26T12:20:05.829768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849361+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:05.849361+0000","last_peered":"2024-02-26T12:20:05.849361+0000","last_clean":"2024-02-26T12:20:05.849361+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:05.849361+0000","last_undegraded":"2024-02-26T12:20:05.849361+0000","last_fullsized":"2024-02-26T12:20:05.849361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833818+0000","last_change":"2024-02-26T12:20:05.833818+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833818+0000","last_undegraded":"2024-02-26T12:20:05.833818+0000","last_fullsized":"2024-02-26T12:20:05.833818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847020+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:05.847020+0000","last_peered":"2024-02-26T12:20:05.847020+0000","last_clean":"2024-02-26T12:20:05.847020+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:05.847020+0000","last_undegraded":"2024-02-26T12:20:05.847020+0000","last_fullsized":"2024-02-26T12:20:05.847020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840293+0000","last_change":"2024-02-26T12:20:05.840293+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840293+0000","last_undegraded":"2024-02-26T12:20:05.840293+0000","last_fullsized":"2024-02-26T12:20:05.840293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846969+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:05.846969+0000","last_peered":"2024-02-26T12:20:05.846969+0000","last_clean":"2024-02-26T12:20:05.846969+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:05.846969+0000","last_undegraded":"2024-02-26T12:20:05.846969+0000","last_fullsized":"2024-02-26T12:20:05.846969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832475+0000","last_change":"2024-02-26T12:20:05.832475+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832475+0000","last_undegraded":"2024-02-26T12:20:05.832475+0000","last_fullsized":"2024-02-26T12:20:05.832475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849364+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:05.849364+0000","last_peered":"2024-02-26T12:20:05.849364+0000","last_clean":"2024-02-26T12:20:05.849364+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:05.849364+0000","last_undegraded":"2024-02-26T12:20:05.849364+0000","last_fullsized":"2024-02-26T12:20:05.849364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834094+0000","last_change":"2024-02-26T12:20:05.834094+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834094+0000","last_undegraded":"2024-02-26T12:20:05.834094+0000","last_fullsized":"2024-02-26T12:20:05.834094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850673+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:05.850673+0000","last_peered":"2024-02-26T12:20:05.850673+0000","last_clean":"2024-02-26T12:20:05.850673+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:05.850673+0000","last_undegraded":"2024-02-26T12:20:05.850673+0000","last_fullsized":"2024-02-26T12:20:05.850673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:36.730929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830976+0000","last_change":"2024-02-26T12:20:05.830976+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830976+0000","last_undegraded":"2024-02-26T12:20:05.830976+0000","last_fullsized":"2024-02-26T12:20:05.830976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842241+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:05.842241+0000","last_peered":"2024-02-26T12:20:05.842241+0000","last_clean":"2024-02-26T12:20:05.842241+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:05.842241+0000","last_undegraded":"2024-02-26T12:20:05.842241+0000","last_fullsized":"2024-02-26T12:20:05.842241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:48:24.285490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827649+0000","last_change":"2024-02-26T12:20:05.827649+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827649+0000","last_undegraded":"2024-02-26T12:20:05.827649+0000","last_fullsized":"2024-02-26T12:20:05.827649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850631+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:05.850631+0000","last_peered":"2024-02-26T12:20:05.850631+0000","last_clean":"2024-02-26T12:20:05.850631+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:05.850631+0000","last_undegraded":"2024-02-26T12:20:05.850631+0000","last_fullsized":"2024-02-26T12:20:05.850631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:12:09.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827537+0000","last_change":"2024-02-26T12:20:05.827537+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827537+0000","last_undegraded":"2024-02-26T12:20:05.827537+0000","last_fullsized":"2024-02-26T12:20:05.827537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841315+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:05.841315+0000","last_peered":"2024-02-26T12:20:05.841315+0000","last_clean":"2024-02-26T12:20:05.841315+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:05.841315+0000","last_undegraded":"2024-02-26T12:20:05.841315+0000","last_fullsized":"2024-02-26T12:20:05.841315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827627+0000","last_change":"2024-02-26T12:20:05.827627+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827627+0000","last_undegraded":"2024-02-26T12:20:05.827627+0000","last_fullsized":"2024-02-26T12:20:05.827627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853229+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:05.853229+0000","last_peered":"2024-02-26T12:20:05.853229+0000","last_clean":"2024-02-26T12:20:05.853229+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:05.853229+0000","last_undegraded":"2024-02-26T12:20:05.853229+0000","last_fullsized":"2024-02-26T12:20:05.853229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827473+0000","last_change":"2024-02-26T12:20:05.827473+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827473+0000","last_undegraded":"2024-02-26T12:20:05.827473+0000","last_fullsized":"2024-02-26T12:20:05.827473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847870+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:05.847870+0000","last_peered":"2024-02-26T12:20:05.847870+0000","last_clean":"2024-02-26T12:20:05.847870+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:05.847870+0000","last_undegraded":"2024-02-26T12:20:05.847870+0000","last_fullsized":"2024-02-26T12:20:05.847870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:23:03.235433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831987+0000","last_change":"2024-02-26T12:20:05.831987+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831987+0000","last_undegraded":"2024-02-26T12:20:05.831987+0000","last_fullsized":"2024-02-26T12:20:05.831987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842326+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:05.842326+0000","last_peered":"2024-02-26T12:20:05.842326+0000","last_clean":"2024-02-26T12:20:05.842326+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:05.842326+0000","last_undegraded":"2024-02-26T12:20:05.842326+0000","last_fullsized":"2024-02-26T12:20:05.842326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827709+0000","last_change":"2024-02-26T12:20:05.827709+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827709+0000","last_undegraded":"2024-02-26T12:20:05.827709+0000","last_fullsized":"2024-02-26T12:20:05.827709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842659+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:05.842659+0000","last_peered":"2024-02-26T12:20:05.842659+0000","last_clean":"2024-02-26T12:20:05.842659+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:05.842659+0000","last_undegraded":"2024-02-26T12:20:05.842659+0000","last_fullsized":"2024-02-26T12:20:05.842659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831540+0000","last_change":"2024-02-26T12:20:05.831540+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831540+0000","last_undegraded":"2024-02-26T12:20:05.831540+0000","last_fullsized":"2024-02-26T12:20:05.831540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841264+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:05.841264+0000","last_peered":"2024-02-26T12:20:05.841264+0000","last_clean":"2024-02-26T12:20:05.841264+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:05.841264+0000","last_undegraded":"2024-02-26T12:20:05.841264+0000","last_fullsized":"2024-02-26T12:20:05.841264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829278+0000","last_change":"2024-02-26T12:20:05.829278+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829278+0000","last_undegraded":"2024-02-26T12:20:05.829278+0000","last_fullsized":"2024-02-26T12:20:05.829278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.844294+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:05.844294+0000","last_peered":"2024-02-26T12:20:05.844294+0000","last_clean":"2024-02-26T12:20:05.844294+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:05.844294+0000","last_undegraded":"2024-02-26T12:20:05.844294+0000","last_fullsized":"2024-02-26T12:20:05.844294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841213+0000","last_change":"2024-02-26T12:20:05.841213+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841213+0000","last_undegraded":"2024-02-26T12:20:05.841213+0000","last_fullsized":"2024-02-26T12:20:05.841213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841295+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:05.841295+0000","last_peered":"2024-02-26T12:20:05.841295+0000","last_clean":"2024-02-26T12:20:05.841295+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:05.841295+0000","last_undegraded":"2024-02-26T12:20:05.841295+0000","last_fullsized":"2024-02-26T12:20:05.841295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830435+0000","last_change":"2024-02-26T12:20:05.830435+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830435+0000","last_undegraded":"2024-02-26T12:20:05.830435+0000","last_fullsized":"2024-02-26T12:20:05.830435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.843379+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:05.843379+0000","last_peered":"2024-02-26T12:20:05.843379+0000","last_clean":"2024-02-26T12:20:05.843379+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:05.843379+0000","last_undegraded":"2024-02-26T12:20:05.843379+0000","last_fullsized":"2024-02-26T12:20:05.843379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829222+0000","last_change":"2024-02-26T12:20:05.829222+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829222+0000","last_undegraded":"2024-02-26T12:20:05.829222+0000","last_fullsized":"2024-02-26T12:20:05.829222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842231+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:05.842231+0000","last_peered":"2024-02-26T12:20:05.842231+0000","last_clean":"2024-02-26T12:20:05.842231+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:05.842231+0000","last_undegraded":"2024-02-26T12:20:05.842231+0000","last_fullsized":"2024-02-26T12:20:05.842231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:27:33.383673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833026+0000","last_change":"2024-02-26T12:20:05.833026+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833026+0000","last_undegraded":"2024-02-26T12:20:05.833026+0000","last_fullsized":"2024-02-26T12:20:05.833026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846928+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:05.846928+0000","last_peered":"2024-02-26T12:20:05.846928+0000","last_clean":"2024-02-26T12:20:05.846928+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:05.846928+0000","last_undegraded":"2024-02-26T12:20:05.846928+0000","last_fullsized":"2024-02-26T12:20:05.846928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832909+0000","last_change":"2024-02-26T12:20:05.832909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832909+0000","last_undegraded":"2024-02-26T12:20:05.832909+0000","last_fullsized":"2024-02-26T12:20:05.832909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853513+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:05.853513+0000","last_peered":"2024-02-26T12:20:05.853513+0000","last_clean":"2024-02-26T12:20:05.853513+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:05.853513+0000","last_undegraded":"2024-02-26T12:20:05.853513+0000","last_fullsized":"2024-02-26T12:20:05.853513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.834753+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:05.834753+0000","last_peered":"2024-02-26T12:20:05.834753+0000","last_clean":"2024-02-26T12:20:05.834753+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:05.834753+0000","last_undegraded":"2024-02-26T12:20:05.834753+0000","last_fullsized":"2024-02-26T12:20:05.834753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:10.124 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.276+0000 7fac18676640 1 Processor -- start 2024-02-26T12:20:10.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.276+0000 7fac18676640 1 -- start start 2024-02-26T12:20:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac18676640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac100715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac18676640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fac10071b10 0x7fac100ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac18676640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac100cf670 con 0x7fac100cee60 2024-02-26T12:20:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac18676640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac10145840 con 0x7fac10071b10 2024-02-26T12:20:10.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac18676640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100cf950 con 0x7fac100711f0 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16412640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac100715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac15c11640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fac10071b10 0x7fac100ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16c13640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fac100cee60 0x7fac1006db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:47630/0 (socket says 172.21.15.113:47630) 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16c13640 1 -- 172.21.15.113:0/2328099412 learned_addr learned my addr 172.21.15.113:0/2328099412 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16412640 1 -- 172.21.15.113:0/2328099412 >> v2:172.21.15.152:3300/0 conn(0x7fac10071b10 msgr2=0x7fac100ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16412640 1 --2- 172.21.15.113:0/2328099412 >> v2:172.21.15.152:3300/0 conn(0x7fac10071b10 0x7fac100ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16412640 1 -- 172.21.15.113:0/2328099412 >> v1:172.21.15.152:6789/0 conn(0x7fac100cee60 legacy=0x7fac1006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.277+0000 7fac16412640 1 -- 172.21.15.113:0/2328099412 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100cfc30 con 0x7fac100711f0 2024-02-26T12:20:10.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.278+0000 7fac16412640 1 --2- 172.21.15.113:0/2328099412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac100715d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0097a0 tx=0x7fac0c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934dbaff5b2b2eff server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.278+0000 7fac15410640 1 -- 172.21.15.113:0/2328099412 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c035020 con 0x7fac100711f0 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.278+0000 7fac15410640 1 -- 172.21.15.113:0/2328099412 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c031830 con 0x7fac100711f0 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.278+0000 7fac15410640 1 -- 172.21.15.113:0/2328099412 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c031c00 con 0x7fac100711f0 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 -- 172.21.15.113:0/2328099412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 msgr2=0x7fac100715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 --2- 172.21.15.113:0/2328099412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac100715d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0097a0 tx=0x7fac0c02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 -- 172.21.15.113:0/2328099412 shutdown_connections 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 --2- 172.21.15.113:0/2328099412 >> v2:172.21.15.152:3300/0 conn(0x7fac10071b10 0x7fac100ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 --2- 172.21.15.113:0/2328099412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac100715d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 -- 172.21.15.113:0/2328099412 >> 172.21.15.113:0/2328099412 conn(0x7fac1006ab50 msgr2=0x7fac1006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 -- 172.21.15.113:0/2328099412 shutdown_connections 2024-02-26T12:20:10.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.279+0000 7fac18676640 1 -- 172.21.15.113:0/2328099412 wait complete. 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.280+0000 7fac18676640 1 Processor -- start 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.280+0000 7fac18676640 1 -- start start 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac1015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 0x7fac101e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac100cf290 con 0x7fac10071b10 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10071f90 con 0x7fac100cee60 2024-02-26T12:20:10.269 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac18676640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100cf410 con 0x7fac100711f0 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59352/0 (socket says 172.21.15.113:59352) 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 -- 172.21.15.113:0/3758685199 learned_addr learned my addr 172.21.15.113:0/3758685199 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac16412640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac1015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac16c13640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 0x7fac101e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 -- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 msgr2=0x7fac1015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac1015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 -- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 msgr2=0x7fac101e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 0x7fac101e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac15c11640 1 -- 172.21.15.113:0/3758685199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100cb5c0 con 0x7fac10071b10 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac16412640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac1015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:10.270 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.281+0000 7fac16c13640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 0x7fac101e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac15c11640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fac0000e9e0 tx=0x7fac0000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00017070 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000c9d0 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac100c4760 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000cdc0 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.282+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac100c4d20 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.283+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac10074a50 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.283+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac0001a070 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.284+0000 7fac06ffd640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 0x7fabf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.284+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac0008a5b0 con 0x7fac10071b10 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.284+0000 7fac16412640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 0x7fabf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.271 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.284+0000 7fac16412640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 0x7fabf406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac0c036000 tx=0x7fac0c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.273 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.288+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac000594c0 con 0x7fac10071b10 2024-02-26T12:20:10.440 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.455+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac1015cc00 con 0x7fabf406b4d0 2024-02-26T12:20:10.445 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.461+0000 7fac06ffd640 1 -- 172.21.15.113:0/3758685199 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246633 (secure 0 0 0) 0x7fac1015cc00 con 0x7fabf406b4d0 2024-02-26T12:20:10.448 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:10.449 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 msgr2=0x7fabf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 0x7fabf406d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac0c036000 tx=0x7fac0c008030 comp rx=0 tx=0).stop 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 msgr2=0x7fac101e7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fac0000e9e0 tx=0x7fac0000eea0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 shutdown_connections 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fabf406b4d0 0x7fabf406d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.451 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac100cee60 0x7fac101e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac10071b10 0x7fac101e7100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 --2- 172.21.15.113:0/3758685199 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fac100711f0 0x7fac1015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.463+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 >> 172.21.15.113:0/3758685199 conn(0x7fac1006ab50 msgr2=0x7fac1015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.464+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 shutdown_connections 2024-02-26T12:20:10.452 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.464+0000 7fac18676640 1 -- 172.21.15.113:0/3758685199 wait complete. 2024-02-26T12:20:10.459 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-26T12:20:09.164971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2099008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.347960"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841372+0000","last_change":"2024-02-26T12:20:05.841372+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841372+0000","last_undegraded":"2024-02-26T12:20:05.841372+0000","last_fullsized":"2024-02-26T12:20:05.841372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836173+0000","last_change":"2024-02-26T12:20:05.836173+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836173+0000","last_undegraded":"2024-02-26T12:20:05.836173+0000","last_fullsized":"2024-02-26T12:20:05.836173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831195+0000","last_change":"2024-02-26T12:20:05.831195+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831195+0000","last_undegraded":"2024-02-26T12:20:05.831195+0000","last_fullsized":"2024-02-26T12:20:05.831195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831490+0000","last_change":"2024-02-26T12:20:05.831490+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831490+0000","last_undegraded":"2024-02-26T12:20:05.831490+0000","last_fullsized":"2024-02-26T12:20:05.831490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829072+0000","last_change":"2024-02-26T12:20:05.829072+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829072+0000","last_undegraded":"2024-02-26T12:20:05.829072+0000","last_fullsized":"2024-02-26T12:20:05.829072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835654+0000","last_change":"2024-02-26T12:20:05.835654+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835654+0000","last_undegraded":"2024-02-26T12:20:05.835654+0000","last_fullsized":"2024-02-26T12:20:05.835654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831498+0000","last_change":"2024-02-26T12:20:05.831498+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831498+0000","last_undegraded":"2024-02-26T12:20:05.831498+0000","last_fullsized":"2024-02-26T12:20:05.831498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834583+0000","last_change":"2024-02-26T12:20:05.834583+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834583+0000","last_undegraded":"2024-02-26T12:20:05.834583+0000","last_fullsized":"2024-02-26T12:20:05.834583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837546+0000","last_change":"2024-02-26T12:20:05.837546+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837546+0000","last_undegraded":"2024-02-26T12:20:05.837546+0000","last_fullsized":"2024-02-26T12:20:05.837546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830063+0000","last_change":"2024-02-26T12:20:05.830063+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830063+0000","last_undegraded":"2024-02-26T12:20:05.830063+0000","last_fullsized":"2024-02-26T12:20:05.830063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832605+0000","last_change":"2024-02-26T12:20:05.832605+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832605+0000","last_undegraded":"2024-02-26T12:20:05.832605+0000","last_fullsized":"2024-02-26T12:20:05.832605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830264+0000","last_change":"2024-02-26T12:20:05.830264+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830264+0000","last_undegraded":"2024-02-26T12:20:05.830264+0000","last_fullsized":"2024-02-26T12:20:05.830264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.828596+0000","last_change":"2024-02-26T12:20:05.828596+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.828596+0000","last_undegraded":"2024-02-26T12:20:05.828596+0000","last_fullsized":"2024-02-26T12:20:05.828596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835160+0000","last_change":"2024-02-26T12:20:05.835160+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835160+0000","last_undegraded":"2024-02-26T12:20:05.835160+0000","last_fullsized":"2024-02-26T12:20:05.835160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829731+0000","last_change":"2024-02-26T12:20:05.829731+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829731+0000","last_undegraded":"2024-02-26T12:20:05.829731+0000","last_fullsized":"2024-02-26T12:20:05.829731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832579+0000","last_change":"2024-02-26T12:20:05.832579+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832579+0000","last_undegraded":"2024-02-26T12:20:05.832579+0000","last_fullsized":"2024-02-26T12:20:05.832579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832969+0000","last_change":"2024-02-26T12:20:05.832969+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832969+0000","last_undegraded":"2024-02-26T12:20:05.832969+0000","last_fullsized":"2024-02-26T12:20:05.832969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834789+0000","last_change":"2024-02-26T12:20:05.834789+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834789+0000","last_undegraded":"2024-02-26T12:20:05.834789+0000","last_fullsized":"2024-02-26T12:20:05.834789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834111+0000","last_change":"2024-02-26T12:20:05.834111+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834111+0000","last_undegraded":"2024-02-26T12:20:05.834111+0000","last_fullsized":"2024-02-26T12:20:05.834111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827705+0000","last_change":"2024-02-26T12:20:05.827705+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827705+0000","last_undegraded":"2024-02-26T12:20:05.827705+0000","last_fullsized":"2024-02-26T12:20:05.827705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836667+0000","last_change":"2024-02-26T12:20:05.836667+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836667+0000","last_undegraded":"2024-02-26T12:20:05.836667+0000","last_fullsized":"2024-02-26T12:20:05.836667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837226+0000","last_change":"2024-02-26T12:20:05.837226+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837226+0000","last_undegraded":"2024-02-26T12:20:05.837226+0000","last_fullsized":"2024-02-26T12:20:05.837226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829750+0000","last_change":"2024-02-26T12:20:05.829750+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829750+0000","last_undegraded":"2024-02-26T12:20:05.829750+0000","last_fullsized":"2024-02-26T12:20:05.829750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830909+0000","last_change":"2024-02-26T12:20:05.830909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830909+0000","last_undegraded":"2024-02-26T12:20:05.830909+0000","last_fullsized":"2024-02-26T12:20:05.830909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830804+0000","last_change":"2024-02-26T12:20:05.830804+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830804+0000","last_undegraded":"2024-02-26T12:20:05.830804+0000","last_fullsized":"2024-02-26T12:20:05.830804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832562+0000","last_change":"2024-02-26T12:20:05.832562+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832562+0000","last_undegraded":"2024-02-26T12:20:05.832562+0000","last_fullsized":"2024-02-26T12:20:05.832562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830995+0000","last_change":"2024-02-26T12:20:05.830995+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830995+0000","last_undegraded":"2024-02-26T12:20:05.830995+0000","last_fullsized":"2024-02-26T12:20:05.830995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829695+0000","last_change":"2024-02-26T12:20:05.829695+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829695+0000","last_undegraded":"2024-02-26T12:20:05.829695+0000","last_fullsized":"2024-02-26T12:20:05.829695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833441+0000","last_change":"2024-02-26T12:20:05.833441+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833441+0000","last_undegraded":"2024-02-26T12:20:05.833441+0000","last_fullsized":"2024-02-26T12:20:05.833441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833291+0000","last_change":"2024-02-26T12:20:05.833291+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833291+0000","last_undegraded":"2024-02-26T12:20:05.833291+0000","last_fullsized":"2024-02-26T12:20:05.833291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840768+0000","last_change":"2024-02-26T12:20:05.840768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840768+0000","last_undegraded":"2024-02-26T12:20:05.840768+0000","last_fullsized":"2024-02-26T12:20:05.840768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834216+0000","last_change":"2024-02-26T12:20:05.834216+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834216+0000","last_undegraded":"2024-02-26T12:20:05.834216+0000","last_fullsized":"2024-02-26T12:20:05.834216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831676+0000","last_change":"2024-02-26T12:20:05.831676+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831676+0000","last_undegraded":"2024-02-26T12:20:05.831676+0000","last_fullsized":"2024-02-26T12:20:05.831676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853515+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:05.853515+0000","last_peered":"2024-02-26T12:20:05.853515+0000","last_clean":"2024-02-26T12:20:05.853515+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:05.853515+0000","last_undegraded":"2024-02-26T12:20:05.853515+0000","last_fullsized":"2024-02-26T12:20:05.853515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840915+0000","last_change":"2024-02-26T12:20:05.840915+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840915+0000","last_undegraded":"2024-02-26T12:20:05.840915+0000","last_fullsized":"2024-02-26T12:20:05.840915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842580+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:05.842580+0000","last_peered":"2024-02-26T12:20:05.842580+0000","last_clean":"2024-02-26T12:20:05.842580+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:05.842580+0000","last_undegraded":"2024-02-26T12:20:05.842580+0000","last_fullsized":"2024-02-26T12:20:05.842580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832713+0000","last_change":"2024-02-26T12:20:05.832713+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832713+0000","last_undegraded":"2024-02-26T12:20:05.832713+0000","last_fullsized":"2024-02-26T12:20:05.832713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847008+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:05.847008+0000","last_peered":"2024-02-26T12:20:05.847008+0000","last_clean":"2024-02-26T12:20:05.847008+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:05.847008+0000","last_undegraded":"2024-02-26T12:20:05.847008+0000","last_fullsized":"2024-02-26T12:20:05.847008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:18.597490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830544+0000","last_change":"2024-02-26T12:20:05.830544+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830544+0000","last_undegraded":"2024-02-26T12:20:05.830544+0000","last_fullsized":"2024-02-26T12:20:05.830544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.836818+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:05.836818+0000","last_peered":"2024-02-26T12:20:05.836818+0000","last_clean":"2024-02-26T12:20:05.836818+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:05.836818+0000","last_undegraded":"2024-02-26T12:20:05.836818+0000","last_fullsized":"2024-02-26T12:20:05.836818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:04:45.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832187+0000","last_change":"2024-02-26T12:20:05.832187+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832187+0000","last_undegraded":"2024-02-26T12:20:05.832187+0000","last_fullsized":"2024-02-26T12:20:05.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850688+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:05.850688+0000","last_peered":"2024-02-26T12:20:05.850688+0000","last_clean":"2024-02-26T12:20:05.850688+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:05.850688+0000","last_undegraded":"2024-02-26T12:20:05.850688+0000","last_fullsized":"2024-02-26T12:20:05.850688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830148+0000","last_change":"2024-02-26T12:20:05.830148+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830148+0000","last_undegraded":"2024-02-26T12:20:05.830148+0000","last_fullsized":"2024-02-26T12:20:05.830148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850629+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:05.850629+0000","last_peered":"2024-02-26T12:20:05.850629+0000","last_clean":"2024-02-26T12:20:05.850629+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:05.850629+0000","last_undegraded":"2024-02-26T12:20:05.850629+0000","last_fullsized":"2024-02-26T12:20:05.850629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:52.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831907+0000","last_change":"2024-02-26T12:20:05.831907+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831907+0000","last_undegraded":"2024-02-26T12:20:05.831907+0000","last_fullsized":"2024-02-26T12:20:05.831907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846780+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:05.846780+0000","last_peered":"2024-02-26T12:20:05.846780+0000","last_clean":"2024-02-26T12:20:05.846780+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:05.846780+0000","last_undegraded":"2024-02-26T12:20:05.846780+0000","last_fullsized":"2024-02-26T12:20:05.846780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829406+0000","last_change":"2024-02-26T12:20:05.829406+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829406+0000","last_undegraded":"2024-02-26T12:20:05.829406+0000","last_fullsized":"2024-02-26T12:20:05.829406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847997+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:05.847997+0000","last_peered":"2024-02-26T12:20:05.847997+0000","last_clean":"2024-02-26T12:20:05.847997+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:05.847997+0000","last_undegraded":"2024-02-26T12:20:05.847997+0000","last_fullsized":"2024-02-26T12:20:05.847997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:56.431417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830665+0000","last_change":"2024-02-26T12:20:05.830665+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830665+0000","last_undegraded":"2024-02-26T12:20:05.830665+0000","last_fullsized":"2024-02-26T12:20:05.830665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847012+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:05.847012+0000","last_peered":"2024-02-26T12:20:05.847012+0000","last_clean":"2024-02-26T12:20:05.847012+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:05.847012+0000","last_undegraded":"2024-02-26T12:20:05.847012+0000","last_fullsized":"2024-02-26T12:20:05.847012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832039+0000","last_change":"2024-02-26T12:20:05.832039+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832039+0000","last_undegraded":"2024-02-26T12:20:05.832039+0000","last_fullsized":"2024-02-26T12:20:05.832039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846632+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:05.846632+0000","last_peered":"2024-02-26T12:20:05.846632+0000","last_clean":"2024-02-26T12:20:05.846632+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:05.846632+0000","last_undegraded":"2024-02-26T12:20:05.846632+0000","last_fullsized":"2024-02-26T12:20:05.846632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831589+0000","last_change":"2024-02-26T12:20:05.831589+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831589+0000","last_undegraded":"2024-02-26T12:20:05.831589+0000","last_fullsized":"2024-02-26T12:20:05.831589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842364+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:05.842364+0000","last_peered":"2024-02-26T12:20:05.842364+0000","last_clean":"2024-02-26T12:20:05.842364+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:05.842364+0000","last_undegraded":"2024-02-26T12:20:05.842364+0000","last_fullsized":"2024-02-26T12:20:05.842364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832126+0000","last_change":"2024-02-26T12:20:05.832126+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832126+0000","last_undegraded":"2024-02-26T12:20:05.832126+0000","last_fullsized":"2024-02-26T12:20:05.832126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849225+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:05.849225+0000","last_peered":"2024-02-26T12:20:05.849225+0000","last_clean":"2024-02-26T12:20:05.849225+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:05.849225+0000","last_undegraded":"2024-02-26T12:20:05.849225+0000","last_fullsized":"2024-02-26T12:20:05.849225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:45.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829895+0000","last_change":"2024-02-26T12:20:05.829895+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829895+0000","last_undegraded":"2024-02-26T12:20:05.829895+0000","last_fullsized":"2024-02-26T12:20:05.829895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850665+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:05.850665+0000","last_peered":"2024-02-26T12:20:05.850665+0000","last_clean":"2024-02-26T12:20:05.850665+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:05.850665+0000","last_undegraded":"2024-02-26T12:20:05.850665+0000","last_fullsized":"2024-02-26T12:20:05.850665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:34:09.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829768+0000","last_change":"2024-02-26T12:20:05.829768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829768+0000","last_undegraded":"2024-02-26T12:20:05.829768+0000","last_fullsized":"2024-02-26T12:20:05.829768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849361+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:05.849361+0000","last_peered":"2024-02-26T12:20:05.849361+0000","last_clean":"2024-02-26T12:20:05.849361+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:05.849361+0000","last_undegraded":"2024-02-26T12:20:05.849361+0000","last_fullsized":"2024-02-26T12:20:05.849361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833818+0000","last_change":"2024-02-26T12:20:05.833818+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833818+0000","last_undegraded":"2024-02-26T12:20:05.833818+0000","last_fullsized":"2024-02-26T12:20:05.833818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847020+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:05.847020+0000","last_peered":"2024-02-26T12:20:05.847020+0000","last_clean":"2024-02-26T12:20:05.847020+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:05.847020+0000","last_undegraded":"2024-02-26T12:20:05.847020+0000","last_fullsized":"2024-02-26T12:20:05.847020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840293+0000","last_change":"2024-02-26T12:20:05.840293+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840293+0000","last_undegraded":"2024-02-26T12:20:05.840293+0000","last_fullsized":"2024-02-26T12:20:05.840293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846969+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:05.846969+0000","last_peered":"2024-02-26T12:20:05.846969+0000","last_clean":"2024-02-26T12:20:05.846969+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:05.846969+0000","last_undegraded":"2024-02-26T12:20:05.846969+0000","last_fullsized":"2024-02-26T12:20:05.846969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832475+0000","last_change":"2024-02-26T12:20:05.832475+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832475+0000","last_undegraded":"2024-02-26T12:20:05.832475+0000","last_fullsized":"2024-02-26T12:20:05.832475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849364+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:05.849364+0000","last_peered":"2024-02-26T12:20:05.849364+0000","last_clean":"2024-02-26T12:20:05.849364+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:05.849364+0000","last_undegraded":"2024-02-26T12:20:05.849364+0000","last_fullsized":"2024-02-26T12:20:05.849364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834094+0000","last_change":"2024-02-26T12:20:05.834094+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834094+0000","last_undegraded":"2024-02-26T12:20:05.834094+0000","last_fullsized":"2024-02-26T12:20:05.834094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850673+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:05.850673+0000","last_peered":"2024-02-26T12:20:05.850673+0000","last_clean":"2024-02-26T12:20:05.850673+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:05.850673+0000","last_undegraded":"2024-02-26T12:20:05.850673+0000","last_fullsized":"2024-02-26T12:20:05.850673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:36.730929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830976+0000","last_change":"2024-02-26T12:20:05.830976+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830976+0000","last_undegraded":"2024-02-26T12:20:05.830976+0000","last_fullsized":"2024-02-26T12:20:05.830976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842241+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:05.842241+0000","last_peered":"2024-02-26T12:20:05.842241+0000","last_clean":"2024-02-26T12:20:05.842241+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:05.842241+0000","last_undegraded":"2024-02-26T12:20:05.842241+0000","last_fullsized":"2024-02-26T12:20:05.842241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:48:24.285490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827649+0000","last_change":"2024-02-26T12:20:05.827649+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827649+0000","last_undegraded":"2024-02-26T12:20:05.827649+0000","last_fullsized":"2024-02-26T12:20:05.827649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850631+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:05.850631+0000","last_peered":"2024-02-26T12:20:05.850631+0000","last_clean":"2024-02-26T12:20:05.850631+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:05.850631+0000","last_undegraded":"2024-02-26T12:20:05.850631+0000","last_fullsized":"2024-02-26T12:20:05.850631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:12:09.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827537+0000","last_change":"2024-02-26T12:20:05.827537+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827537+0000","last_undegraded":"2024-02-26T12:20:05.827537+0000","last_fullsized":"2024-02-26T12:20:05.827537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841315+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:05.841315+0000","last_peered":"2024-02-26T12:20:05.841315+0000","last_clean":"2024-02-26T12:20:05.841315+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:05.841315+0000","last_undegraded":"2024-02-26T12:20:05.841315+0000","last_fullsized":"2024-02-26T12:20:05.841315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827627+0000","last_change":"2024-02-26T12:20:05.827627+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827627+0000","last_undegraded":"2024-02-26T12:20:05.827627+0000","last_fullsized":"2024-02-26T12:20:05.827627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853229+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:05.853229+0000","last_peered":"2024-02-26T12:20:05.853229+0000","last_clean":"2024-02-26T12:20:05.853229+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:05.853229+0000","last_undegraded":"2024-02-26T12:20:05.853229+0000","last_fullsized":"2024-02-26T12:20:05.853229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827473+0000","last_change":"2024-02-26T12:20:05.827473+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827473+0000","last_undegraded":"2024-02-26T12:20:05.827473+0000","last_fullsized":"2024-02-26T12:20:05.827473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847870+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:05.847870+0000","last_peered":"2024-02-26T12:20:05.847870+0000","last_clean":"2024-02-26T12:20:05.847870+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:05.847870+0000","last_undegraded":"2024-02-26T12:20:05.847870+0000","last_fullsized":"2024-02-26T12:20:05.847870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:23:03.235433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831987+0000","last_change":"2024-02-26T12:20:05.831987+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831987+0000","last_undegraded":"2024-02-26T12:20:05.831987+0000","last_fullsized":"2024-02-26T12:20:05.831987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842326+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:05.842326+0000","last_peered":"2024-02-26T12:20:05.842326+0000","last_clean":"2024-02-26T12:20:05.842326+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:05.842326+0000","last_undegraded":"2024-02-26T12:20:05.842326+0000","last_fullsized":"2024-02-26T12:20:05.842326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827709+0000","last_change":"2024-02-26T12:20:05.827709+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827709+0000","last_undegraded":"2024-02-26T12:20:05.827709+0000","last_fullsized":"2024-02-26T12:20:05.827709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842659+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:05.842659+0000","last_peered":"2024-02-26T12:20:05.842659+0000","last_clean":"2024-02-26T12:20:05.842659+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:05.842659+0000","last_undegraded":"2024-02-26T12:20:05.842659+0000","last_fullsized":"2024-02-26T12:20:05.842659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831540+0000","last_change":"2024-02-26T12:20:05.831540+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831540+0000","last_undegraded":"2024-02-26T12:20:05.831540+0000","last_fullsized":"2024-02-26T12:20:05.831540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841264+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:05.841264+0000","last_peered":"2024-02-26T12:20:05.841264+0000","last_clean":"2024-02-26T12:20:05.841264+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:05.841264+0000","last_undegraded":"2024-02-26T12:20:05.841264+0000","last_fullsized":"2024-02-26T12:20:05.841264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829278+0000","last_change":"2024-02-26T12:20:05.829278+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829278+0000","last_undegraded":"2024-02-26T12:20:05.829278+0000","last_fullsized":"2024-02-26T12:20:05.829278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.844294+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:05.844294+0000","last_peered":"2024-02-26T12:20:05.844294+0000","last_clean":"2024-02-26T12:20:05.844294+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:05.844294+0000","last_undegraded":"2024-02-26T12:20:05.844294+0000","last_fullsized":"2024-02-26T12:20:05.844294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841213+0000","last_change":"2024-02-26T12:20:05.841213+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841213+0000","last_undegraded":"2024-02-26T12:20:05.841213+0000","last_fullsized":"2024-02-26T12:20:05.841213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841295+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:05.841295+0000","last_peered":"2024-02-26T12:20:05.841295+0000","last_clean":"2024-02-26T12:20:05.841295+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:05.841295+0000","last_undegraded":"2024-02-26T12:20:05.841295+0000","last_fullsized":"2024-02-26T12:20:05.841295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830435+0000","last_change":"2024-02-26T12:20:05.830435+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830435+0000","last_undegraded":"2024-02-26T12:20:05.830435+0000","last_fullsized":"2024-02-26T12:20:05.830435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.843379+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:05.843379+0000","last_peered":"2024-02-26T12:20:05.843379+0000","last_clean":"2024-02-26T12:20:05.843379+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:05.843379+0000","last_undegraded":"2024-02-26T12:20:05.843379+0000","last_fullsized":"2024-02-26T12:20:05.843379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829222+0000","last_change":"2024-02-26T12:20:05.829222+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829222+0000","last_undegraded":"2024-02-26T12:20:05.829222+0000","last_fullsized":"2024-02-26T12:20:05.829222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842231+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:05.842231+0000","last_peered":"2024-02-26T12:20:05.842231+0000","last_clean":"2024-02-26T12:20:05.842231+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:05.842231+0000","last_undegraded":"2024-02-26T12:20:05.842231+0000","last_fullsized":"2024-02-26T12:20:05.842231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:27:33.383673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833026+0000","last_change":"2024-02-26T12:20:05.833026+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833026+0000","last_undegraded":"2024-02-26T12:20:05.833026+0000","last_fullsized":"2024-02-26T12:20:05.833026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846928+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:05.846928+0000","last_peered":"2024-02-26T12:20:05.846928+0000","last_clean":"2024-02-26T12:20:05.846928+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:05.846928+0000","last_undegraded":"2024-02-26T12:20:05.846928+0000","last_fullsized":"2024-02-26T12:20:05.846928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832909+0000","last_change":"2024-02-26T12:20:05.832909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832909+0000","last_undegraded":"2024-02-26T12:20:05.832909+0000","last_fullsized":"2024-02-26T12:20:05.832909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853513+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:05.853513+0000","last_peered":"2024-02-26T12:20:05.853513+0000","last_clean":"2024-02-26T12:20:05.853513+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:05.853513+0000","last_undegraded":"2024-02-26T12:20:05.853513+0000","last_fullsized":"2024-02-26T12:20:05.853513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.834753+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:05.834753+0000","last_peered":"2024-02-26T12:20:05.834753+0000","last_clean":"2024-02-26T12:20:05.834753+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:05.834753+0000","last_undegraded":"2024-02-26T12:20:05.834753+0000","last_fullsized":"2024-02-26T12:20:05.834753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.841372+0000', 'last_change': '2024-02-26T12:20:05.841372+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.841372+0000', 'last_undegraded': '2024-02-26T12:20:05.841372+0000', 'last_fullsized': '2024-02-26T12:20:05.841372+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.836173+0000', 'last_change': '2024-02-26T12:20:05.836173+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.836173+0000', 'last_undegraded': '2024-02-26T12:20:05.836173+0000', 'last_fullsized': '2024-02-26T12:20:05.836173+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831195+0000', 'last_change': '2024-02-26T12:20:05.831195+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831195+0000', 'last_undegraded': '2024-02-26T12:20:05.831195+0000', 'last_fullsized': '2024-02-26T12:20:05.831195+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-02-26T12:20:10.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831490+0000', 'last_change': '2024-02-26T12:20:05.831490+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831490+0000', 'last_undegraded': '2024-02-26T12:20:05.831490+0000', 'last_fullsized': '2024-02-26T12:20:05.831490+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829072+0000', 'last_change': '2024-02-26T12:20:05.829072+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829072+0000', 'last_undegraded': '2024-02-26T12:20:05.829072+0000', 'last_fullsized': '2024-02-26T12:20:05.829072+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.835654+0000', 'last_change': '2024-02-26T12:20:05.835654+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.835654+0000', 'last_undegraded': '2024-02-26T12:20:05.835654+0000', 'last_fullsized': '2024-02-26T12:20:05.835654+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831498+0000', 'last_change': '2024-02-26T12:20:05.831498+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831498+0000', 'last_undegraded': '2024-02-26T12:20:05.831498+0000', 'last_fullsized': '2024-02-26T12:20:05.831498+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.834583+0000', 'last_change': '2024-02-26T12:20:05.834583+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.834583+0000', 'last_undegraded': '2024-02-26T12:20:05.834583+0000', 'last_fullsized': '2024-02-26T12:20:05.834583+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.837546+0000', 'last_change': '2024-02-26T12:20:05.837546+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.837546+0000', 'last_undegraded': '2024-02-26T12:20:05.837546+0000', 'last_fullsized': '2024-02-26T12:20:05.837546+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830063+0000', 'last_change': '2024-02-26T12:20:05.830063+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830063+0000', 'last_undegraded': '2024-02-26T12:20:05.830063+0000', 'last_fullsized': '2024-02-26T12:20:05.830063+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832605+0000', 'last_change': '2024-02-26T12:20:05.832605+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832605+0000', 'last_undegraded': '2024-02-26T12:20:05.832605+0000', 'last_fullsized': '2024-02-26T12:20:05.832605+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830264+0000', 'last_change': '2024-02-26T12:20:05.830264+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830264+0000', 'last_undegraded': '2024-02-26T12:20:05.830264+0000', 'last_fullsized': '2024-02-26T12:20:05.830264+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.828596+0000', 'last_change': '2024-02-26T12:20:05.828596+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.828596+0000', 'last_undegraded': '2024-02-26T12:20:05.828596+0000', 'last_fullsized': '2024-02-26T12:20:05.828596+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.835160+0000', 'last_change': '2024-02-26T12:20:05.835160+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.835160+0000', 'last_undegraded': '2024-02-26T12:20:05.835160+0000', 'last_fullsized': '2024-02-26T12:20:05.835160+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-02-26T12:20:10.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829731+0000', 'last_change': '2024-02-26T12:20:05.829731+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829731+0000', 'last_undegraded': '2024-02-26T12:20:05.829731+0000', 'last_fullsized': '2024-02-26T12:20:05.829731+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832579+0000', 'last_change': '2024-02-26T12:20:05.832579+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832579+0000', 'last_undegraded': '2024-02-26T12:20:05.832579+0000', 'last_fullsized': '2024-02-26T12:20:05.832579+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832969+0000', 'last_change': '2024-02-26T12:20:05.832969+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832969+0000', 'last_undegraded': '2024-02-26T12:20:05.832969+0000', 'last_fullsized': '2024-02-26T12:20:05.832969+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.834789+0000', 'last_change': '2024-02-26T12:20:05.834789+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.834789+0000', 'last_undegraded': '2024-02-26T12:20:05.834789+0000', 'last_fullsized': '2024-02-26T12:20:05.834789+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.834111+0000', 'last_change': '2024-02-26T12:20:05.834111+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.834111+0000', 'last_undegraded': '2024-02-26T12:20:05.834111+0000', 'last_fullsized': '2024-02-26T12:20:05.834111+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827705+0000', 'last_change': '2024-02-26T12:20:05.827705+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827705+0000', 'last_undegraded': '2024-02-26T12:20:05.827705+0000', 'last_fullsized': '2024-02-26T12:20:05.827705+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.836667+0000', 'last_change': '2024-02-26T12:20:05.836667+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.836667+0000', 'last_undegraded': '2024-02-26T12:20:05.836667+0000', 'last_fullsized': '2024-02-26T12:20:05.836667+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.837226+0000', 'last_change': '2024-02-26T12:20:05.837226+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.837226+0000', 'last_undegraded': '2024-02-26T12:20:05.837226+0000', 'last_fullsized': '2024-02-26T12:20:05.837226+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829750+0000', 'last_change': '2024-02-26T12:20:05.829750+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829750+0000', 'last_undegraded': '2024-02-26T12:20:05.829750+0000', 'last_fullsized': '2024-02-26T12:20:05.829750+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830909+0000', 'last_change': '2024-02-26T12:20:05.830909+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830909+0000', 'last_undegraded': '2024-02-26T12:20:05.830909+0000', 'last_fullsized': '2024-02-26T12:20:05.830909+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830804+0000', 'last_change': '2024-02-26T12:20:05.830804+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830804+0000', 'last_undegraded': '2024-02-26T12:20:05.830804+0000', 'last_fullsized': '2024-02-26T12:20:05.830804+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832562+0000', 'last_change': '2024-02-26T12:20:05.832562+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832562+0000', 'last_undegraded': '2024-02-26T12:20:05.832562+0000', 'last_fullsized': '2024-02-26T12:20:05.832562+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830995+0000', 'last_change': '2024-02-26T12:20:05.830995+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830995+0000', 'last_undegraded': '2024-02-26T12:20:05.830995+0000', 'last_fullsized': '2024-02-26T12:20:05.830995+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829695+0000', 'last_change': '2024-02-26T12:20:05.829695+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829695+0000', 'last_undegraded': '2024-02-26T12:20:05.829695+0000', 'last_fullsized': '2024-02-26T12:20:05.829695+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.833441+0000', 'last_change': '2024-02-26T12:20:05.833441+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.833441+0000', 'last_undegraded': '2024-02-26T12:20:05.833441+0000', 'last_fullsized': '2024-02-26T12:20:05.833441+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.833291+0000', 'last_change': '2024-02-26T12:20:05.833291+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.833291+0000', 'last_undegraded': '2024-02-26T12:20:05.833291+0000', 'last_fullsized': '2024-02-26T12:20:05.833291+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-02-26T12:20:10.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.840768+0000', 'last_change': '2024-02-26T12:20:05.840768+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.840768+0000', 'last_undegraded': '2024-02-26T12:20:05.840768+0000', 'last_fullsized': '2024-02-26T12:20:05.840768+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.834216+0000', 'last_change': '2024-02-26T12:20:05.834216+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.834216+0000', 'last_undegraded': '2024-02-26T12:20:05.834216+0000', 'last_fullsized': '2024-02-26T12:20:05.834216+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831676+0000', 'last_change': '2024-02-26T12:20:05.831676+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831676+0000', 'last_undegraded': '2024-02-26T12:20:05.831676+0000', 'last_fullsized': '2024-02-26T12:20:05.831676+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.840915+0000', 'last_change': '2024-02-26T12:20:05.840915+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.840915+0000', 'last_undegraded': '2024-02-26T12:20:05.840915+0000', 'last_fullsized': '2024-02-26T12:20:05.840915+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832713+0000', 'last_change': '2024-02-26T12:20:05.832713+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832713+0000', 'last_undegraded': '2024-02-26T12:20:05.832713+0000', 'last_fullsized': '2024-02-26T12:20:05.832713+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830544+0000', 'last_change': '2024-02-26T12:20:05.830544+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830544+0000', 'last_undegraded': '2024-02-26T12:20:05.830544+0000', 'last_fullsized': '2024-02-26T12:20:05.830544+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832187+0000', 'last_change': '2024-02-26T12:20:05.832187+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832187+0000', 'last_undegraded': '2024-02-26T12:20:05.832187+0000', 'last_fullsized': '2024-02-26T12:20:05.832187+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830148+0000', 'last_change': '2024-02-26T12:20:05.830148+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830148+0000', 'last_undegraded': '2024-02-26T12:20:05.830148+0000', 'last_fullsized': '2024-02-26T12:20:05.830148+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831907+0000', 'last_change': '2024-02-26T12:20:05.831907+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831907+0000', 'last_undegraded': '2024-02-26T12:20:05.831907+0000', 'last_fullsized': '2024-02-26T12:20:05.831907+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829406+0000', 'last_change': '2024-02-26T12:20:05.829406+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829406+0000', 'last_undegraded': '2024-02-26T12:20:05.829406+0000', 'last_fullsized': '2024-02-26T12:20:05.829406+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830665+0000', 'last_change': '2024-02-26T12:20:05.830665+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830665+0000', 'last_undegraded': '2024-02-26T12:20:05.830665+0000', 'last_fullsized': '2024-02-26T12:20:05.830665+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-02-26T12:20:10.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832039+0000', 'last_change': '2024-02-26T12:20:05.832039+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832039+0000', 'last_undegraded': '2024-02-26T12:20:05.832039+0000', 'last_fullsized': '2024-02-26T12:20:05.832039+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831589+0000', 'last_change': '2024-02-26T12:20:05.831589+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831589+0000', 'last_undegraded': '2024-02-26T12:20:05.831589+0000', 'last_fullsized': '2024-02-26T12:20:05.831589+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832126+0000', 'last_change': '2024-02-26T12:20:05.832126+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832126+0000', 'last_undegraded': '2024-02-26T12:20:05.832126+0000', 'last_fullsized': '2024-02-26T12:20:05.832126+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829895+0000', 'last_change': '2024-02-26T12:20:05.829895+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829895+0000', 'last_undegraded': '2024-02-26T12:20:05.829895+0000', 'last_fullsized': '2024-02-26T12:20:05.829895+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829768+0000', 'last_change': '2024-02-26T12:20:05.829768+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829768+0000', 'last_undegraded': '2024-02-26T12:20:05.829768+0000', 'last_fullsized': '2024-02-26T12:20:05.829768+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-02-26T12:20:10.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.833818+0000', 'last_change': '2024-02-26T12:20:05.833818+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.833818+0000', 'last_undegraded': '2024-02-26T12:20:05.833818+0000', 'last_fullsized': '2024-02-26T12:20:05.833818+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.840293+0000', 'last_change': '2024-02-26T12:20:05.840293+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.840293+0000', 'last_undegraded': '2024-02-26T12:20:05.840293+0000', 'last_fullsized': '2024-02-26T12:20:05.840293+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832475+0000', 'last_change': '2024-02-26T12:20:05.832475+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832475+0000', 'last_undegraded': '2024-02-26T12:20:05.832475+0000', 'last_fullsized': '2024-02-26T12:20:05.832475+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.834094+0000', 'last_change': '2024-02-26T12:20:05.834094+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.834094+0000', 'last_undegraded': '2024-02-26T12:20:05.834094+0000', 'last_fullsized': '2024-02-26T12:20:05.834094+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830976+0000', 'last_change': '2024-02-26T12:20:05.830976+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830976+0000', 'last_undegraded': '2024-02-26T12:20:05.830976+0000', 'last_fullsized': '2024-02-26T12:20:05.830976+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827649+0000', 'last_change': '2024-02-26T12:20:05.827649+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827649+0000', 'last_undegraded': '2024-02-26T12:20:05.827649+0000', 'last_fullsized': '2024-02-26T12:20:05.827649+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827537+0000', 'last_change': '2024-02-26T12:20:05.827537+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827537+0000', 'last_undegraded': '2024-02-26T12:20:05.827537+0000', 'last_fullsized': '2024-02-26T12:20:05.827537+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827627+0000', 'last_change': '2024-02-26T12:20:05.827627+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827627+0000', 'last_undegraded': '2024-02-26T12:20:05.827627+0000', 'last_fullsized': '2024-02-26T12:20:05.827627+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827473+0000', 'last_change': '2024-02-26T12:20:05.827473+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827473+0000', 'last_undegraded': '2024-02-26T12:20:05.827473+0000', 'last_fullsized': '2024-02-26T12:20:05.827473+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831987+0000', 'last_change': '2024-02-26T12:20:05.831987+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831987+0000', 'last_undegraded': '2024-02-26T12:20:05.831987+0000', 'last_fullsized': '2024-02-26T12:20:05.831987+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.827709+0000', 'last_change': '2024-02-26T12:20:05.827709+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.827709+0000', 'last_undegraded': '2024-02-26T12:20:05.827709+0000', 'last_fullsized': '2024-02-26T12:20:05.827709+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.831540+0000', 'last_change': '2024-02-26T12:20:05.831540+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.831540+0000', 'last_undegraded': '2024-02-26T12:20:05.831540+0000', 'last_fullsized': '2024-02-26T12:20:05.831540+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829278+0000', 'last_change': '2024-02-26T12:20:05.829278+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829278+0000', 'last_undegraded': '2024-02-26T12:20:05.829278+0000', 'last_fullsized': '2024-02-26T12:20:05.829278+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.841213+0000', 'last_change': '2024-02-26T12:20:05.841213+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.841213+0000', 'last_undegraded': '2024-02-26T12:20:05.841213+0000', 'last_fullsized': '2024-02-26T12:20:05.841213+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.830435+0000', 'last_change': '2024-02-26T12:20:05.830435+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.830435+0000', 'last_undegraded': '2024-02-26T12:20:05.830435+0000', 'last_fullsized': '2024-02-26T12:20:05.830435+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-02-26T12:20:10.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.829222+0000', 'last_change': '2024-02-26T12:20:05.829222+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.829222+0000', 'last_undegraded': '2024-02-26T12:20:05.829222+0000', 'last_fullsized': '2024-02-26T12:20:05.829222+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-02-26T12:20:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-02-26T12:20:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.833026+0000', 'last_change': '2024-02-26T12:20:05.833026+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.833026+0000', 'last_undegraded': '2024-02-26T12:20:05.833026+0000', 'last_fullsized': '2024-02-26T12:20:05.833026+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-02-26T12:20:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-02-26T12:20:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-02-26T12:20:05.832909+0000', 'last_change': '2024-02-26T12:20:05.832909+0000', 'last_active': '2024-02-26T12:20:05.814713+0000', 'last_peered': '2024-02-26T12:20:05.814713+0000', 'last_clean': '2024-02-26T12:20:05.814713+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-26T12:20:05.832909+0000', 'last_undegraded': '2024-02-26T12:20:05.832909+0000', 'last_fullsized': '2024-02-26T12:20:05.832909+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'last_clean_scrub_stamp': '2024-02-26T12:20:05.814713+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-02-26T12:20:10.476 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-26T12:20:10.575 INFO:tasks.ceph.mds.c.smithi113.stderr:2024-02-26T12:20:10.590+0000 7f8d5b9e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-26T12:20:10.600 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.615+0000 7f076e399640 1 Processor -- start 2024-02-26T12:20:10.601 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.615+0000 7f076e399640 1 -- start start 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076e399640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f07680cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076e399640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f07680b3350 0x7f07680b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076e399640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680cc5f0 con 0x7f076815bb50 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076e399640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0768070c60 con 0x7f07680b3350 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076e399640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680cc8a0 con 0x7f07680d0d00 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f0767fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f076815bb50 0x7f07680716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54724/0 (socket says 172.21.15.113:54724) 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f0767fff640 1 -- 172.21.15.113:0/451797264 learned_addr learned my addr 172.21.15.113:0/451797264 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f076c936640 1 --2- 172.21.15.113:0/451797264 >> v2:172.21.15.152:3300/0 conn(0x7f07680b3350 0x7f07680b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364956879 0 0) 0x7f07680cc5f0 con 0x7f076815bb50 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750003520 con 0x7f076815bb50 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.616+0000 7f07677fe640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f07680cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.605 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794067004 0 0) 0x7f0750003520 con 0x7f076815bb50 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 msgr2=0x7f07680cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f07680cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 >> v2:172.21.15.152:3300/0 conn(0x7f07680b3350 msgr2=0x7f07680b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 --2- 172.21.15.113:0/451797264 >> v2:172.21.15.152:3300/0 conn(0x7f07680b3350 0x7f07680b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680ccb80 con 0x7f076815bb50 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f0758001670 con 0x7f076815bb50 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 >> v1:172.21.15.113:6789/0 conn(0x7f076815bb50 legacy=0x7f07680716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f0750003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f0750004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750004d40 0x7f07500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768070c60 con 0x7f07500039b0 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680cc8a0 con 0x7f0750004d40 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075000b9c0 con 0x7f07680d0d00 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f0750003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.606 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f07677fe640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f0750004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f076c936640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750004d40 0x7f07500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 -- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 msgr2=0x7f0750004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07680d0d00 0x7f0750004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 -- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750004d40 msgr2=0x7f07500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0750004d40 0x7f07500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.617+0000 7f0767fff640 1 -- 172.21.15.113:0/451797264 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0750003520 con 0x7f07500039b0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f0767fff640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f0750003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f075800c290 tx=0x7f0750005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b04318554a5027 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758007d30 con 0x7f07500039b0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758030070 con 0x7f07500039b0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f0766ffd640 1 -- 172.21.15.113:0/451797264 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758005d30 con 0x7f07500039b0 2024-02-26T12:20:10.607 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f076e399640 1 -- 172.21.15.113:0/451797264 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 msgr2=0x7f0750003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.618+0000 7f076e399640 1 --2- 172.21.15.113:0/451797264 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f0750003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f075800c290 tx=0x7f0750005830 comp rx=0 tx=0).stop 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.619+0000 7f076c936640 1 -- 172.21.15.113:0/451797264 reap_dead start 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.619+0000 7f076e399640 1 -- 172.21.15.113:0/451797264 shutdown_connections 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.619+0000 7f076e399640 1 -- 172.21.15.113:0/451797264 >> 172.21.15.113:0/451797264 conn(0x7f07680ce350 msgr2=0x7f07680ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.619+0000 7f076e399640 1 -- 172.21.15.113:0/451797264 shutdown_connections 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.619+0000 7f076e399640 1 -- 172.21.15.113:0/451797264 wait complete. 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.620+0000 7f076e399640 1 Processor -- start 2024-02-26T12:20:10.608 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.620+0000 7f076e399640 1 -- start start 2024-02-26T12:20:10.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 0x7f076815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 0x7f07680c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076815bf30 con 0x7f07500039b0 2024-02-26T12:20:10.611 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768071190 con 0x7f076815c780 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076806cb90 con 0x7f076806d580 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59382/0 (socket says 172.21.15.113:59382) 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 -- 172.21.15.113:0/3646260925 learned_addr learned my addr 172.21.15.113:0/3646260925 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076c936640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 0x7f07680c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f07677fe640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 0x7f076815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 -- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 msgr2=0x7f076815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 0x7f076815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 -- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 msgr2=0x7f07680c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 0x7f07680c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 -- 172.21.15.113:0/3646260925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076806c5d0 con 0x7f07500039b0 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076c936640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 0x7f07680c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:10.612 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f07677fe640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 0x7f076815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0767fff640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0758001970 tx=0x7f0758000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758001c80 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758004bf0 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076806c8b0 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758007070 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.621+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07680c91f0 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.622+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0768074a50 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.623+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0758007210 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.623+0000 7f0764ff9640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 0x7f075406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.623+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07580ab2c0 con 0x7f07500039b0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.623+0000 7f07677fe640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 0x7f075406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.613 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.624+0000 7f07677fe640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 0x7f075406d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f076806d9a0 tx=0x7f075c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.614 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.628+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f075807a140 con 0x7f07500039b0 2024-02-26T12:20:10.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.866+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f07680d0ac0 con 0x7f07500039b0 2024-02-26T12:20:10.852 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.867+0000 7f0764ff9640 1 -- 172.21.15.113:0/3646260925 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1581 (secure 0 0 0) 0x7f0758079a40 con 0x7f07500039b0 2024-02-26T12:20:10.852 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:10.853 INFO:teuthology.orchestra.run.smithi113.stdout:{"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1708949945,"num_in_osds":8,"osd_in_since":1708949937,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225026048,"bytes_avail":772869087232,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5019}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-02-26T12:20:07.164675+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-26T12:20:10.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 msgr2=0x7f075406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 0x7f075406d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f076806d9a0 tx=0x7f075c008040 comp rx=0 tx=0).stop 2024-02-26T12:20:10.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 msgr2=0x7f076806bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0758001970 tx=0x7f0758000fe0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.854 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 shutdown_connections 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f075406b4d0 0x7f075406d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f076815c780 0x7f07680c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f076806d580 0x7f076815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 --2- 172.21.15.113:0/3646260925 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07500039b0 0x7f076806bc60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 >> 172.21.15.113:0/3646260925 conn(0x7f07680ce350 msgr2=0x7f0768071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 shutdown_connections 2024-02-26T12:20:10.855 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.869+0000 7f076e399640 1 -- 172.21.15.113:0/3646260925 wait complete. 2024-02-26T12:20:10.865 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-26T12:20:10.865 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:10.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.980+0000 7f6a6f3b4640 1 Processor -- start 2024-02-26T12:20:10.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.980+0000 7f6a6f3b4640 1 -- start start 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6f3b4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6a6815db00 0x7f6a680cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6f3b4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a680b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6f3b4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a680711d0 con 0x7f6a68070c60 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6f3b4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a680714b0 con 0x7f6a6815db00 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6f3b4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68071790 con 0x7f6a6815dee0 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6d951640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6a68070c60 0x7f6a68161840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54740/0 (socket says 172.21.15.113:54740) 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6d951640 1 -- 172.21.15.113:0/3787805363 learned_addr learned my addr 172.21.15.113:0/3787805363 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811081701 0 0) 0x7f6a680711d0 con 0x7f6a68070c60 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a54003520 con 0x7f6a68070c60 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a680b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6d150640 1 --2- 172.21.15.113:0/3787805363 >> v2:172.21.15.152:3300/0 conn(0x7f6a6815db00 0x7f6a680cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259311195 0 0) 0x7f6a54003520 con 0x7f6a68070c60 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 msgr2=0x7f6a680b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a680b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 >> v2:172.21.15.152:3300/0 conn(0x7f6a6815db00 msgr2=0x7f6a680cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 --2- 172.21.15.113:0/3787805363 >> v2:172.21.15.152:3300/0 conn(0x7f6a6815db00 0x7f6a680cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68071a70 con 0x7f6a68070c60 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f6a600019f0 con 0x7f6a68070c60 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a6d150640 1 --2- 172.21.15.113:0/3787805363 >> v2:172.21.15.152:3300/0 conn(0x7f6a6815db00 0x7f6a680cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 >> v1:172.21.15.113:6789/0 conn(0x7f6a68070c60 legacy=0x7f6a68161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a54003f30 0x7f6a54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.981+0000 7f6a5ffff640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680714b0 con 0x7f6a54003f30 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a68071790 con 0x7f6a54004d40 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5400ba10 con 0x7f6a6815dee0 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a54003f30 0x7f6a54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6d150640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6d951640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 -- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 msgr2=0x7f6a540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 -- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54004d40 msgr2=0x7f6a540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54004d40 0x7f6a540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6c94f640 1 -- 172.21.15.113:0/3787805363 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54003520 con 0x7f6a54003f30 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.982+0000 7f6a6d150640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a6815dee0 0x7f6a540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a54003f30 0x7f6a54004800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009ac0 tx=0x7f6a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803ac2c922ab782d server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58039070 con 0x7f6a54003f30 2024-02-26T12:20:10.971 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5802c6b0 con 0x7f6a54003f30 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a5ffff640 1 -- 172.21.15.113:0/3787805363 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58009690 con 0x7f6a54003f30 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/3787805363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a54003f30 msgr2=0x7f6a54004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/3787805363 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a54003f30 0x7f6a54004800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009ac0 tx=0x7f6a54005830 comp rx=0 tx=0).stop 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6d951640 1 -- 172.21.15.113:0/3787805363 reap_dead start 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/3787805363 shutdown_connections 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/3787805363 >> 172.21.15.113:0/3787805363 conn(0x7f6a680ce350 msgr2=0x7f6a680ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/3787805363 shutdown_connections 2024-02-26T12:20:10.972 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.983+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/3787805363 wait complete. 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.984+0000 7f6a6f3b4640 1 Processor -- start 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.984+0000 7f6a6f3b4640 1 -- start start 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54003f30 0x7f6a680cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 0x7f6a681f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6806c150 con 0x7f6a6806cfd0 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a680d03f0 con 0x7f6a54003f30 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6f3b4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6806c2d0 con 0x7f6a681f6540 2024-02-26T12:20:10.975 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59392/0 (socket says 172.21.15.113:59392) 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 -- 172.21.15.113:0/976834098 learned_addr learned my addr 172.21.15.113:0/976834098 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6d951640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 0x7f6a681f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 -- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 msgr2=0x7f6a681f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 0x7f6a681f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 -- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54003f30 msgr2=0x7f6a680cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54003f30 0x7f6a680cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6c94f640 1 -- 172.21.15.113:0/976834098 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a681f6f00 con 0x7f6a6806cfd0 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.985+0000 7f6a6d951640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 0x7f6a681f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a6c94f640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009be0 tx=0x7f6a58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58042020 con 0x7f6a6806cfd0 2024-02-26T12:20:10.976 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5803a040 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a6815f3a0 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58039070 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.986+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a6815f960 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.987+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a6806ddf0 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.987+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a58045020 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.988+0000 7f6a5dffb640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 0x7f6a4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.988+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a580ab5b0 con 0x7f6a6806cfd0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.988+0000 7f6a6d150640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 0x7f6a4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.988+0000 7f6a6d150640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 0x7f6a4c06d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a64006e80 tx=0x7f6a64006df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:10.977 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:10.992+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a5804c070 con 0x7f6a6806cfd0 2024-02-26T12:20:11.145 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.159+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a680b7850 con 0x7f6a4c06b4d0 2024-02-26T12:20:11.150 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.165+0000 7f6a5dffb640 1 -- 172.21.15.113:0/976834098 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246633 (secure 0 0 0) 0x7f6a680b7850 con 0x7f6a4c06b4d0 2024-02-26T12:20:11.153 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:11.154 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:11.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.168+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 msgr2=0x7f6a4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:11.155 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 0x7f6a4c06d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a64006e80 tx=0x7f6a64006df0 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 msgr2=0x7f6a6806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009be0 tx=0x7f6a58004730 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 shutdown_connections 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6a4c06b4d0 0x7f6a4c06d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6a681f6540 0x7f6a681f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6a6806cfd0 0x7f6a6806d450 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 --2- 172.21.15.113:0/976834098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a54003f30 0x7f6a680cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 >> 172.21.15.113:0/976834098 conn(0x7f6a680ce350 msgr2=0x7f6a680b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 shutdown_connections 2024-02-26T12:20:11.156 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:11.169+0000 7f6a6f3b4640 1 -- 172.21.15.113:0/976834098 wait complete. 2024-02-26T12:20:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-02-26T12:20:09.164971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2099008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.347960"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841372+0000","last_change":"2024-02-26T12:20:05.841372+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841372+0000","last_undegraded":"2024-02-26T12:20:05.841372+0000","last_fullsized":"2024-02-26T12:20:05.841372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836173+0000","last_change":"2024-02-26T12:20:05.836173+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836173+0000","last_undegraded":"2024-02-26T12:20:05.836173+0000","last_fullsized":"2024-02-26T12:20:05.836173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831195+0000","last_change":"2024-02-26T12:20:05.831195+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831195+0000","last_undegraded":"2024-02-26T12:20:05.831195+0000","last_fullsized":"2024-02-26T12:20:05.831195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831490+0000","last_change":"2024-02-26T12:20:05.831490+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831490+0000","last_undegraded":"2024-02-26T12:20:05.831490+0000","last_fullsized":"2024-02-26T12:20:05.831490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829072+0000","last_change":"2024-02-26T12:20:05.829072+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829072+0000","last_undegraded":"2024-02-26T12:20:05.829072+0000","last_fullsized":"2024-02-26T12:20:05.829072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835654+0000","last_change":"2024-02-26T12:20:05.835654+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835654+0000","last_undegraded":"2024-02-26T12:20:05.835654+0000","last_fullsized":"2024-02-26T12:20:05.835654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831498+0000","last_change":"2024-02-26T12:20:05.831498+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831498+0000","last_undegraded":"2024-02-26T12:20:05.831498+0000","last_fullsized":"2024-02-26T12:20:05.831498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834583+0000","last_change":"2024-02-26T12:20:05.834583+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834583+0000","last_undegraded":"2024-02-26T12:20:05.834583+0000","last_fullsized":"2024-02-26T12:20:05.834583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837546+0000","last_change":"2024-02-26T12:20:05.837546+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837546+0000","last_undegraded":"2024-02-26T12:20:05.837546+0000","last_fullsized":"2024-02-26T12:20:05.837546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830063+0000","last_change":"2024-02-26T12:20:05.830063+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830063+0000","last_undegraded":"2024-02-26T12:20:05.830063+0000","last_fullsized":"2024-02-26T12:20:05.830063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832605+0000","last_change":"2024-02-26T12:20:05.832605+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832605+0000","last_undegraded":"2024-02-26T12:20:05.832605+0000","last_fullsized":"2024-02-26T12:20:05.832605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830264+0000","last_change":"2024-02-26T12:20:05.830264+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830264+0000","last_undegraded":"2024-02-26T12:20:05.830264+0000","last_fullsized":"2024-02-26T12:20:05.830264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.828596+0000","last_change":"2024-02-26T12:20:05.828596+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.828596+0000","last_undegraded":"2024-02-26T12:20:05.828596+0000","last_fullsized":"2024-02-26T12:20:05.828596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.835160+0000","last_change":"2024-02-26T12:20:05.835160+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.835160+0000","last_undegraded":"2024-02-26T12:20:05.835160+0000","last_fullsized":"2024-02-26T12:20:05.835160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829731+0000","last_change":"2024-02-26T12:20:05.829731+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829731+0000","last_undegraded":"2024-02-26T12:20:05.829731+0000","last_fullsized":"2024-02-26T12:20:05.829731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832579+0000","last_change":"2024-02-26T12:20:05.832579+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832579+0000","last_undegraded":"2024-02-26T12:20:05.832579+0000","last_fullsized":"2024-02-26T12:20:05.832579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832969+0000","last_change":"2024-02-26T12:20:05.832969+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832969+0000","last_undegraded":"2024-02-26T12:20:05.832969+0000","last_fullsized":"2024-02-26T12:20:05.832969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834789+0000","last_change":"2024-02-26T12:20:05.834789+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834789+0000","last_undegraded":"2024-02-26T12:20:05.834789+0000","last_fullsized":"2024-02-26T12:20:05.834789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834111+0000","last_change":"2024-02-26T12:20:05.834111+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834111+0000","last_undegraded":"2024-02-26T12:20:05.834111+0000","last_fullsized":"2024-02-26T12:20:05.834111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827705+0000","last_change":"2024-02-26T12:20:05.827705+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827705+0000","last_undegraded":"2024-02-26T12:20:05.827705+0000","last_fullsized":"2024-02-26T12:20:05.827705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.836667+0000","last_change":"2024-02-26T12:20:05.836667+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.836667+0000","last_undegraded":"2024-02-26T12:20:05.836667+0000","last_fullsized":"2024-02-26T12:20:05.836667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.837226+0000","last_change":"2024-02-26T12:20:05.837226+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.837226+0000","last_undegraded":"2024-02-26T12:20:05.837226+0000","last_fullsized":"2024-02-26T12:20:05.837226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829750+0000","last_change":"2024-02-26T12:20:05.829750+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829750+0000","last_undegraded":"2024-02-26T12:20:05.829750+0000","last_fullsized":"2024-02-26T12:20:05.829750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830909+0000","last_change":"2024-02-26T12:20:05.830909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830909+0000","last_undegraded":"2024-02-26T12:20:05.830909+0000","last_fullsized":"2024-02-26T12:20:05.830909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830804+0000","last_change":"2024-02-26T12:20:05.830804+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830804+0000","last_undegraded":"2024-02-26T12:20:05.830804+0000","last_fullsized":"2024-02-26T12:20:05.830804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832562+0000","last_change":"2024-02-26T12:20:05.832562+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832562+0000","last_undegraded":"2024-02-26T12:20:05.832562+0000","last_fullsized":"2024-02-26T12:20:05.832562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830995+0000","last_change":"2024-02-26T12:20:05.830995+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830995+0000","last_undegraded":"2024-02-26T12:20:05.830995+0000","last_fullsized":"2024-02-26T12:20:05.830995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829695+0000","last_change":"2024-02-26T12:20:05.829695+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829695+0000","last_undegraded":"2024-02-26T12:20:05.829695+0000","last_fullsized":"2024-02-26T12:20:05.829695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833441+0000","last_change":"2024-02-26T12:20:05.833441+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833441+0000","last_undegraded":"2024-02-26T12:20:05.833441+0000","last_fullsized":"2024-02-26T12:20:05.833441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833291+0000","last_change":"2024-02-26T12:20:05.833291+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833291+0000","last_undegraded":"2024-02-26T12:20:05.833291+0000","last_fullsized":"2024-02-26T12:20:05.833291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840768+0000","last_change":"2024-02-26T12:20:05.840768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840768+0000","last_undegraded":"2024-02-26T12:20:05.840768+0000","last_fullsized":"2024-02-26T12:20:05.840768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834216+0000","last_change":"2024-02-26T12:20:05.834216+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834216+0000","last_undegraded":"2024-02-26T12:20:05.834216+0000","last_fullsized":"2024-02-26T12:20:05.834216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831676+0000","last_change":"2024-02-26T12:20:05.831676+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831676+0000","last_undegraded":"2024-02-26T12:20:05.831676+0000","last_fullsized":"2024-02-26T12:20:05.831676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853515+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:05.853515+0000","last_peered":"2024-02-26T12:20:05.853515+0000","last_clean":"2024-02-26T12:20:05.853515+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:05.853515+0000","last_undegraded":"2024-02-26T12:20:05.853515+0000","last_fullsized":"2024-02-26T12:20:05.853515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840915+0000","last_change":"2024-02-26T12:20:05.840915+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840915+0000","last_undegraded":"2024-02-26T12:20:05.840915+0000","last_fullsized":"2024-02-26T12:20:05.840915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842580+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:05.842580+0000","last_peered":"2024-02-26T12:20:05.842580+0000","last_clean":"2024-02-26T12:20:05.842580+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:05.842580+0000","last_undegraded":"2024-02-26T12:20:05.842580+0000","last_fullsized":"2024-02-26T12:20:05.842580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832713+0000","last_change":"2024-02-26T12:20:05.832713+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832713+0000","last_undegraded":"2024-02-26T12:20:05.832713+0000","last_fullsized":"2024-02-26T12:20:05.832713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847008+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:05.847008+0000","last_peered":"2024-02-26T12:20:05.847008+0000","last_clean":"2024-02-26T12:20:05.847008+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:05.847008+0000","last_undegraded":"2024-02-26T12:20:05.847008+0000","last_fullsized":"2024-02-26T12:20:05.847008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:18.597490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830544+0000","last_change":"2024-02-26T12:20:05.830544+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830544+0000","last_undegraded":"2024-02-26T12:20:05.830544+0000","last_fullsized":"2024-02-26T12:20:05.830544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.836818+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:05.836818+0000","last_peered":"2024-02-26T12:20:05.836818+0000","last_clean":"2024-02-26T12:20:05.836818+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:05.836818+0000","last_undegraded":"2024-02-26T12:20:05.836818+0000","last_fullsized":"2024-02-26T12:20:05.836818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:04:45.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832187+0000","last_change":"2024-02-26T12:20:05.832187+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832187+0000","last_undegraded":"2024-02-26T12:20:05.832187+0000","last_fullsized":"2024-02-26T12:20:05.832187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850688+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:05.850688+0000","last_peered":"2024-02-26T12:20:05.850688+0000","last_clean":"2024-02-26T12:20:05.850688+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:05.850688+0000","last_undegraded":"2024-02-26T12:20:05.850688+0000","last_fullsized":"2024-02-26T12:20:05.850688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830148+0000","last_change":"2024-02-26T12:20:05.830148+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830148+0000","last_undegraded":"2024-02-26T12:20:05.830148+0000","last_fullsized":"2024-02-26T12:20:05.830148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850629+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:05.850629+0000","last_peered":"2024-02-26T12:20:05.850629+0000","last_clean":"2024-02-26T12:20:05.850629+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:05.850629+0000","last_undegraded":"2024-02-26T12:20:05.850629+0000","last_fullsized":"2024-02-26T12:20:05.850629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:52.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831907+0000","last_change":"2024-02-26T12:20:05.831907+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831907+0000","last_undegraded":"2024-02-26T12:20:05.831907+0000","last_fullsized":"2024-02-26T12:20:05.831907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846780+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:05.846780+0000","last_peered":"2024-02-26T12:20:05.846780+0000","last_clean":"2024-02-26T12:20:05.846780+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:05.846780+0000","last_undegraded":"2024-02-26T12:20:05.846780+0000","last_fullsized":"2024-02-26T12:20:05.846780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829406+0000","last_change":"2024-02-26T12:20:05.829406+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829406+0000","last_undegraded":"2024-02-26T12:20:05.829406+0000","last_fullsized":"2024-02-26T12:20:05.829406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847997+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:05.847997+0000","last_peered":"2024-02-26T12:20:05.847997+0000","last_clean":"2024-02-26T12:20:05.847997+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:05.847997+0000","last_undegraded":"2024-02-26T12:20:05.847997+0000","last_fullsized":"2024-02-26T12:20:05.847997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:05:56.431417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830665+0000","last_change":"2024-02-26T12:20:05.830665+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830665+0000","last_undegraded":"2024-02-26T12:20:05.830665+0000","last_fullsized":"2024-02-26T12:20:05.830665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847012+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:05.847012+0000","last_peered":"2024-02-26T12:20:05.847012+0000","last_clean":"2024-02-26T12:20:05.847012+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:05.847012+0000","last_undegraded":"2024-02-26T12:20:05.847012+0000","last_fullsized":"2024-02-26T12:20:05.847012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832039+0000","last_change":"2024-02-26T12:20:05.832039+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832039+0000","last_undegraded":"2024-02-26T12:20:05.832039+0000","last_fullsized":"2024-02-26T12:20:05.832039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846632+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:05.846632+0000","last_peered":"2024-02-26T12:20:05.846632+0000","last_clean":"2024-02-26T12:20:05.846632+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:05.846632+0000","last_undegraded":"2024-02-26T12:20:05.846632+0000","last_fullsized":"2024-02-26T12:20:05.846632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831589+0000","last_change":"2024-02-26T12:20:05.831589+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831589+0000","last_undegraded":"2024-02-26T12:20:05.831589+0000","last_fullsized":"2024-02-26T12:20:05.831589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842364+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:05.842364+0000","last_peered":"2024-02-26T12:20:05.842364+0000","last_clean":"2024-02-26T12:20:05.842364+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:05.842364+0000","last_undegraded":"2024-02-26T12:20:05.842364+0000","last_fullsized":"2024-02-26T12:20:05.842364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832126+0000","last_change":"2024-02-26T12:20:05.832126+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832126+0000","last_undegraded":"2024-02-26T12:20:05.832126+0000","last_fullsized":"2024-02-26T12:20:05.832126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849225+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:05.849225+0000","last_peered":"2024-02-26T12:20:05.849225+0000","last_clean":"2024-02-26T12:20:05.849225+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:05.849225+0000","last_undegraded":"2024-02-26T12:20:05.849225+0000","last_fullsized":"2024-02-26T12:20:05.849225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:45.066355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829895+0000","last_change":"2024-02-26T12:20:05.829895+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829895+0000","last_undegraded":"2024-02-26T12:20:05.829895+0000","last_fullsized":"2024-02-26T12:20:05.829895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850665+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:05.850665+0000","last_peered":"2024-02-26T12:20:05.850665+0000","last_clean":"2024-02-26T12:20:05.850665+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:05.850665+0000","last_undegraded":"2024-02-26T12:20:05.850665+0000","last_fullsized":"2024-02-26T12:20:05.850665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:34:09.664710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829768+0000","last_change":"2024-02-26T12:20:05.829768+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829768+0000","last_undegraded":"2024-02-26T12:20:05.829768+0000","last_fullsized":"2024-02-26T12:20:05.829768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849361+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:05.849361+0000","last_peered":"2024-02-26T12:20:05.849361+0000","last_clean":"2024-02-26T12:20:05.849361+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:05.849361+0000","last_undegraded":"2024-02-26T12:20:05.849361+0000","last_fullsized":"2024-02-26T12:20:05.849361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833818+0000","last_change":"2024-02-26T12:20:05.833818+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833818+0000","last_undegraded":"2024-02-26T12:20:05.833818+0000","last_fullsized":"2024-02-26T12:20:05.833818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847020+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:05.847020+0000","last_peered":"2024-02-26T12:20:05.847020+0000","last_clean":"2024-02-26T12:20:05.847020+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:05.847020+0000","last_undegraded":"2024-02-26T12:20:05.847020+0000","last_fullsized":"2024-02-26T12:20:05.847020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.840293+0000","last_change":"2024-02-26T12:20:05.840293+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.840293+0000","last_undegraded":"2024-02-26T12:20:05.840293+0000","last_fullsized":"2024-02-26T12:20:05.840293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846969+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:05.846969+0000","last_peered":"2024-02-26T12:20:05.846969+0000","last_clean":"2024-02-26T12:20:05.846969+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:05.846969+0000","last_undegraded":"2024-02-26T12:20:05.846969+0000","last_fullsized":"2024-02-26T12:20:05.846969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832475+0000","last_change":"2024-02-26T12:20:05.832475+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832475+0000","last_undegraded":"2024-02-26T12:20:05.832475+0000","last_fullsized":"2024-02-26T12:20:05.832475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.849364+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:05.849364+0000","last_peered":"2024-02-26T12:20:05.849364+0000","last_clean":"2024-02-26T12:20:05.849364+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:05.849364+0000","last_undegraded":"2024-02-26T12:20:05.849364+0000","last_fullsized":"2024-02-26T12:20:05.849364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.834094+0000","last_change":"2024-02-26T12:20:05.834094+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.834094+0000","last_undegraded":"2024-02-26T12:20:05.834094+0000","last_fullsized":"2024-02-26T12:20:05.834094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850673+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:05.850673+0000","last_peered":"2024-02-26T12:20:05.850673+0000","last_clean":"2024-02-26T12:20:05.850673+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:05.850673+0000","last_undegraded":"2024-02-26T12:20:05.850673+0000","last_fullsized":"2024-02-26T12:20:05.850673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:36.730929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830976+0000","last_change":"2024-02-26T12:20:05.830976+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830976+0000","last_undegraded":"2024-02-26T12:20:05.830976+0000","last_fullsized":"2024-02-26T12:20:05.830976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842241+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:05.842241+0000","last_peered":"2024-02-26T12:20:05.842241+0000","last_clean":"2024-02-26T12:20:05.842241+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:05.842241+0000","last_undegraded":"2024-02-26T12:20:05.842241+0000","last_fullsized":"2024-02-26T12:20:05.842241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:48:24.285490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827649+0000","last_change":"2024-02-26T12:20:05.827649+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827649+0000","last_undegraded":"2024-02-26T12:20:05.827649+0000","last_fullsized":"2024-02-26T12:20:05.827649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.850631+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:05.850631+0000","last_peered":"2024-02-26T12:20:05.850631+0000","last_clean":"2024-02-26T12:20:05.850631+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:05.850631+0000","last_undegraded":"2024-02-26T12:20:05.850631+0000","last_fullsized":"2024-02-26T12:20:05.850631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:12:09.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827537+0000","last_change":"2024-02-26T12:20:05.827537+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827537+0000","last_undegraded":"2024-02-26T12:20:05.827537+0000","last_fullsized":"2024-02-26T12:20:05.827537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841315+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:05.841315+0000","last_peered":"2024-02-26T12:20:05.841315+0000","last_clean":"2024-02-26T12:20:05.841315+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:05.841315+0000","last_undegraded":"2024-02-26T12:20:05.841315+0000","last_fullsized":"2024-02-26T12:20:05.841315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827627+0000","last_change":"2024-02-26T12:20:05.827627+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827627+0000","last_undegraded":"2024-02-26T12:20:05.827627+0000","last_fullsized":"2024-02-26T12:20:05.827627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853229+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:05.853229+0000","last_peered":"2024-02-26T12:20:05.853229+0000","last_clean":"2024-02-26T12:20:05.853229+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:05.853229+0000","last_undegraded":"2024-02-26T12:20:05.853229+0000","last_fullsized":"2024-02-26T12:20:05.853229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827473+0000","last_change":"2024-02-26T12:20:05.827473+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827473+0000","last_undegraded":"2024-02-26T12:20:05.827473+0000","last_fullsized":"2024-02-26T12:20:05.827473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.847870+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:05.847870+0000","last_peered":"2024-02-26T12:20:05.847870+0000","last_clean":"2024-02-26T12:20:05.847870+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:05.847870+0000","last_undegraded":"2024-02-26T12:20:05.847870+0000","last_fullsized":"2024-02-26T12:20:05.847870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:23:03.235433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831987+0000","last_change":"2024-02-26T12:20:05.831987+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831987+0000","last_undegraded":"2024-02-26T12:20:05.831987+0000","last_fullsized":"2024-02-26T12:20:05.831987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842326+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:05.842326+0000","last_peered":"2024-02-26T12:20:05.842326+0000","last_clean":"2024-02-26T12:20:05.842326+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:05.842326+0000","last_undegraded":"2024-02-26T12:20:05.842326+0000","last_fullsized":"2024-02-26T12:20:05.842326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.827709+0000","last_change":"2024-02-26T12:20:05.827709+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.827709+0000","last_undegraded":"2024-02-26T12:20:05.827709+0000","last_fullsized":"2024-02-26T12:20:05.827709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842659+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:05.842659+0000","last_peered":"2024-02-26T12:20:05.842659+0000","last_clean":"2024-02-26T12:20:05.842659+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:05.842659+0000","last_undegraded":"2024-02-26T12:20:05.842659+0000","last_fullsized":"2024-02-26T12:20:05.842659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.831540+0000","last_change":"2024-02-26T12:20:05.831540+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.831540+0000","last_undegraded":"2024-02-26T12:20:05.831540+0000","last_fullsized":"2024-02-26T12:20:05.831540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841264+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:05.841264+0000","last_peered":"2024-02-26T12:20:05.841264+0000","last_clean":"2024-02-26T12:20:05.841264+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:05.841264+0000","last_undegraded":"2024-02-26T12:20:05.841264+0000","last_fullsized":"2024-02-26T12:20:05.841264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829278+0000","last_change":"2024-02-26T12:20:05.829278+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829278+0000","last_undegraded":"2024-02-26T12:20:05.829278+0000","last_fullsized":"2024-02-26T12:20:05.829278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.844294+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:05.844294+0000","last_peered":"2024-02-26T12:20:05.844294+0000","last_clean":"2024-02-26T12:20:05.844294+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:05.844294+0000","last_undegraded":"2024-02-26T12:20:05.844294+0000","last_fullsized":"2024-02-26T12:20:05.844294+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.841213+0000","last_change":"2024-02-26T12:20:05.841213+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.841213+0000","last_undegraded":"2024-02-26T12:20:05.841213+0000","last_fullsized":"2024-02-26T12:20:05.841213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.841295+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:05.841295+0000","last_peered":"2024-02-26T12:20:05.841295+0000","last_clean":"2024-02-26T12:20:05.841295+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:05.841295+0000","last_undegraded":"2024-02-26T12:20:05.841295+0000","last_fullsized":"2024-02-26T12:20:05.841295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:14.219047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.830435+0000","last_change":"2024-02-26T12:20:05.830435+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.830435+0000","last_undegraded":"2024-02-26T12:20:05.830435+0000","last_fullsized":"2024-02-26T12:20:05.830435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.843379+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:05.843379+0000","last_peered":"2024-02-26T12:20:05.843379+0000","last_clean":"2024-02-26T12:20:05.843379+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:05.843379+0000","last_undegraded":"2024-02-26T12:20:05.843379+0000","last_fullsized":"2024-02-26T12:20:05.843379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.829222+0000","last_change":"2024-02-26T12:20:05.829222+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.829222+0000","last_undegraded":"2024-02-26T12:20:05.829222+0000","last_fullsized":"2024-02-26T12:20:05.829222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.842231+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:05.842231+0000","last_peered":"2024-02-26T12:20:05.842231+0000","last_clean":"2024-02-26T12:20:05.842231+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:05.842231+0000","last_undegraded":"2024-02-26T12:20:05.842231+0000","last_fullsized":"2024-02-26T12:20:05.842231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:27:33.383673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.833026+0000","last_change":"2024-02-26T12:20:05.833026+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.833026+0000","last_undegraded":"2024-02-26T12:20:05.833026+0000","last_fullsized":"2024-02-26T12:20:05.833026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.846928+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:05.846928+0000","last_peered":"2024-02-26T12:20:05.846928+0000","last_clean":"2024-02-26T12:20:05.846928+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:05.846928+0000","last_undegraded":"2024-02-26T12:20:05.846928+0000","last_fullsized":"2024-02-26T12:20:05.846928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-02-26T12:20:05.832909+0000","last_change":"2024-02-26T12:20:05.832909+0000","last_active":"2024-02-26T12:20:05.814713+0000","last_peered":"2024-02-26T12:20:05.814713+0000","last_clean":"2024-02-26T12:20:05.814713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-26T12:20:05.832909+0000","last_undegraded":"2024-02-26T12:20:05.832909+0000","last_fullsized":"2024-02-26T12:20:05.832909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.853513+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:05.853513+0000","last_peered":"2024-02-26T12:20:05.853513+0000","last_clean":"2024-02-26T12:20:05.853513+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:05.853513+0000","last_undegraded":"2024-02-26T12:20:05.853513+0000","last_fullsized":"2024-02-26T12:20:05.853513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-26T12:20:05.834753+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:05.834753+0000","last_peered":"2024-02-26T12:20:05.834753+0000","last_clean":"2024-02-26T12:20:05.834753+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:05.834753+0000","last_undegraded":"2024-02-26T12:20:05.834753+0000","last_fullsized":"2024-02-26T12:20:05.834753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":114784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:14.172 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:14.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.298+0000 7f52d3d15640 1 Processor -- start 2024-02-26T12:20:14.284 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.299+0000 7f52d3d15640 1 -- start start 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.299+0000 7f52d3d15640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52cc0cac50 0x7f52cc070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.299+0000 7f52d3d15640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc06b700 con 0x7f52cc15ddf0 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.299+0000 7f52d3d15640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc06b9e0 con 0x7f52cc0cebb0 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.299+0000 7f52d3d15640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc06bcc0 con 0x7f52cc0cac50 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d12b0640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52cc0cac50 0x7f52cc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d1ab1640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f52cc15ddf0 0x7f52cc0ca540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54746/0 (socket says 172.21.15.113:54746) 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d1ab1640 1 -- 172.21.15.113:0/2337292544 learned_addr learned my addr 172.21.15.113:0/2337292544 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:14.285 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d12b0640 1 -- 172.21.15.113:0/2337292544 >> v1:172.21.15.152:6789/0 conn(0x7f52cc0cebb0 legacy=0x7f52cc167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d12b0640 1 -- 172.21.15.113:0/2337292544 >> v1:172.21.15.113:6789/0 conn(0x7f52cc15ddf0 legacy=0x7f52cc0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d0aaf640 1 -- 172.21.15.113:0/2337292544 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066356660 0 0) 0x7f52cc06b700 con 0x7f52cc15ddf0 2024-02-26T12:20:14.286 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.300+0000 7f52d12b0640 1 -- 172.21.15.113:0/2337292544 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc06bfa0 con 0x7f52cc0cac50 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d12b0640 1 --2- 172.21.15.113:0/2337292544 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cac50 0x7f52cc070010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3f8550f7964f2c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d0aaf640 1 -- 172.21.15.113:0/2337292544 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc038070 con 0x7f52cc0cac50 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d0aaf640 1 -- 172.21.15.113:0/2337292544 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc031700 con 0x7f52cc0cac50 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d0aaf640 1 -- 172.21.15.113:0/2337292544 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc031ad0 con 0x7f52cc0cac50 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d3d15640 1 -- 172.21.15.113:0/2337292544 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cac50 msgr2=0x7f52cc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d3d15640 1 --2- 172.21.15.113:0/2337292544 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cac50 0x7f52cc070010 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02b7a0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d3d15640 1 -- 172.21.15.113:0/2337292544 shutdown_connections 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d3d15640 1 --2- 172.21.15.113:0/2337292544 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cac50 0x7f52cc070010 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.301+0000 7f52d3d15640 1 -- 172.21.15.113:0/2337292544 >> 172.21.15.113:0/2337292544 conn(0x7f52cc0cc970 msgr2=0x7f52cc0ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.302+0000 7f52d3d15640 1 -- 172.21.15.113:0/2337292544 shutdown_connections 2024-02-26T12:20:14.287 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.302+0000 7f52d3d15640 1 -- 172.21.15.113:0/2337292544 wait complete. 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.303+0000 7f52d3d15640 1 Processor -- start 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.303+0000 7f52d3d15640 1 -- start start 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.303+0000 7f52d3d15640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52cc0cac50 0x7f52cc0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.303+0000 7f52d3d15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.303+0000 7f52d3d15640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52cc15ddf0 0x7f52cc0a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d3d15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc168f20 con 0x7f52cc0cebb0 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d3d15640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0cfbc0 con 0x7f52cc0cac50 2024-02-26T12:20:14.290 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d3d15640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1690a0 con 0x7f52cc15ddf0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59418/0 (socket says 172.21.15.113:59418) 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 -- 172.21.15.113:0/3090420197 learned_addr learned my addr 172.21.15.113:0/3090420197 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d1ab1640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52cc0cac50 0x7f52cc0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d22b2640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52cc15ddf0 0x7f52cc0a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 -- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52cc15ddf0 msgr2=0x7f52cc0a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52cc15ddf0 0x7f52cc0a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 -- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52cc0cac50 msgr2=0x7f52cc0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52cc0cac50 0x7f52cc0c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 -- 172.21.15.113:0/3090420197 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc1568a0 con 0x7f52cc0cebb0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d12b0640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc038040 con 0x7f52cc0cebb0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc033a30 con 0x7f52cc0cebb0 2024-02-26T12:20:14.291 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc006e10 con 0x7f52cc0cebb0 2024-02-26T12:20:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc09f320 con 0x7f52cc0cebb0 2024-02-26T12:20:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.304+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc09f8e0 con 0x7f52cc0cebb0 2024-02-26T12:20:14.292 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.305+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc074a50 con 0x7f52cc0cebb0 2024-02-26T12:20:14.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.306+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52bc004030 con 0x7f52cc0cebb0 2024-02-26T12:20:14.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.306+0000 7f52c27fc640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.306+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52bc0abf20 con 0x7f52cc0cebb0 2024-02-26T12:20:14.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.306+0000 7f52d1ab1640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.293 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.307+0000 7f52d1ab1640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 0x7f52b006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c8000f60 tx=0x7f52c8007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.295 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.311+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52bc043020 con 0x7f52cc0cebb0 2024-02-26T12:20:14.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.478+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52cc070260 con 0x7f52b006b4d0 2024-02-26T12:20:14.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.483+0000 7f52c27fc640 1 -- 172.21.15.113:0/3090420197 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251951 (secure 0 0 0) 0x7f52cc070260 con 0x7f52b006b4d0 2024-02-26T12:20:14.471 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:14.472 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 msgr2=0x7f52b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 0x7f52b006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c8000f60 tx=0x7f52c8007b50 comp rx=0 tx=0).stop 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 msgr2=0x7f52cc0a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc0046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 shutdown_connections 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f52b006b4d0 0x7f52b006d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52cc15ddf0 0x7f52cc0a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52cc0cebb0 0x7f52cc0a06b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 --2- 172.21.15.113:0/3090420197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52cc0cac50 0x7f52cc0c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 >> 172.21.15.113:0/3090420197 conn(0x7f52cc0cc970 msgr2=0x7f52cc06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:14.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 shutdown_connections 2024-02-26T12:20:14.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.487+0000 7f52d3d15640 1 -- 172.21.15.113:0/3090420197 wait complete. 2024-02-26T12:20:14.483 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-02-26T12:20:13.166541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220108,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754612,"statfs":{"total":773094113280,"available":772868722688,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.343337"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352976+0000","last_change":"2024-02-26T12:20:06.844968+0000","last_active":"2024-02-26T12:20:08.352976+0000","last_peered":"2024-02-26T12:20:08.352976+0000","last_clean":"2024-02-26T12:20:08.352976+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:08.352976+0000","last_undegraded":"2024-02-26T12:20:08.352976+0000","last_fullsized":"2024-02-26T12:20:08.352976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:50.636359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353304+0000","last_change":"2024-02-26T12:20:06.849184+0000","last_active":"2024-02-26T12:20:08.353304+0000","last_peered":"2024-02-26T12:20:08.353304+0000","last_clean":"2024-02-26T12:20:08.353304+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:08.353304+0000","last_undegraded":"2024-02-26T12:20:08.353304+0000","last_fullsized":"2024-02-26T12:20:08.353304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841079+0000","last_change":"2024-02-26T12:20:06.834964+0000","last_active":"2024-02-26T12:20:07.841079+0000","last_peered":"2024-02-26T12:20:07.841079+0000","last_clean":"2024-02-26T12:20:07.841079+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:07.841079+0000","last_undegraded":"2024-02-26T12:20:07.841079+0000","last_fullsized":"2024-02-26T12:20:07.841079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352362+0000","last_change":"2024-02-26T12:20:06.852832+0000","last_active":"2024-02-26T12:20:08.352362+0000","last_peered":"2024-02-26T12:20:08.352362+0000","last_clean":"2024-02-26T12:20:08.352362+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:08.352362+0000","last_undegraded":"2024-02-26T12:20:08.352362+0000","last_fullsized":"2024-02-26T12:20:08.352362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352062+0000","last_change":"2024-02-26T12:20:06.852324+0000","last_active":"2024-02-26T12:20:08.352062+0000","last_peered":"2024-02-26T12:20:08.352062+0000","last_clean":"2024-02-26T12:20:08.352062+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:08.352062+0000","last_undegraded":"2024-02-26T12:20:08.352062+0000","last_fullsized":"2024-02-26T12:20:08.352062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:54.685782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352961+0000","last_change":"2024-02-26T12:20:06.849421+0000","last_active":"2024-02-26T12:20:08.352961+0000","last_peered":"2024-02-26T12:20:08.352961+0000","last_clean":"2024-02-26T12:20:08.352961+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:08.352961+0000","last_undegraded":"2024-02-26T12:20:08.352961+0000","last_fullsized":"2024-02-26T12:20:08.352961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353217+0000","last_change":"2024-02-26T12:20:06.843366+0000","last_active":"2024-02-26T12:20:08.353217+0000","last_peered":"2024-02-26T12:20:08.353217+0000","last_clean":"2024-02-26T12:20:08.353217+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:08.353217+0000","last_undegraded":"2024-02-26T12:20:08.353217+0000","last_fullsized":"2024-02-26T12:20:08.353217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:25.589137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352342+0000","last_change":"2024-02-26T12:20:06.839766+0000","last_active":"2024-02-26T12:20:08.352342+0000","last_peered":"2024-02-26T12:20:08.352342+0000","last_clean":"2024-02-26T12:20:08.352342+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:08.352342+0000","last_undegraded":"2024-02-26T12:20:08.352342+0000","last_fullsized":"2024-02-26T12:20:08.352342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841973+0000","last_change":"2024-02-26T12:20:06.848927+0000","last_active":"2024-02-26T12:20:07.841973+0000","last_peered":"2024-02-26T12:20:07.841973+0000","last_clean":"2024-02-26T12:20:07.841973+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:07.841973+0000","last_undegraded":"2024-02-26T12:20:07.841973+0000","last_fullsized":"2024-02-26T12:20:07.841973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352274+0000","last_change":"2024-02-26T12:20:06.850295+0000","last_active":"2024-02-26T12:20:08.352274+0000","last_peered":"2024-02-26T12:20:08.352274+0000","last_clean":"2024-02-26T12:20:08.352274+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:08.352274+0000","last_undegraded":"2024-02-26T12:20:08.352274+0000","last_fullsized":"2024-02-26T12:20:08.352274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353066+0000","last_change":"2024-02-26T12:20:06.846792+0000","last_active":"2024-02-26T12:20:08.353066+0000","last_peered":"2024-02-26T12:20:08.353066+0000","last_clean":"2024-02-26T12:20:08.353066+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:08.353066+0000","last_undegraded":"2024-02-26T12:20:08.353066+0000","last_fullsized":"2024-02-26T12:20:08.353066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840815+0000","last_change":"2024-02-26T12:20:06.850771+0000","last_active":"2024-02-26T12:20:07.840815+0000","last_peered":"2024-02-26T12:20:07.840815+0000","last_clean":"2024-02-26T12:20:07.840815+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:07.840815+0000","last_undegraded":"2024-02-26T12:20:07.840815+0000","last_fullsized":"2024-02-26T12:20:07.840815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352210+0000","last_change":"2024-02-26T12:20:06.845105+0000","last_active":"2024-02-26T12:20:08.352210+0000","last_peered":"2024-02-26T12:20:08.352210+0000","last_clean":"2024-02-26T12:20:08.352210+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:08.352210+0000","last_undegraded":"2024-02-26T12:20:08.352210+0000","last_fullsized":"2024-02-26T12:20:08.352210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:37.707892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353101+0000","last_change":"2024-02-26T12:20:06.849132+0000","last_active":"2024-02-26T12:20:08.353101+0000","last_peered":"2024-02-26T12:20:08.353101+0000","last_clean":"2024-02-26T12:20:08.353101+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:08.353101+0000","last_undegraded":"2024-02-26T12:20:08.353101+0000","last_fullsized":"2024-02-26T12:20:08.353101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840492+0000","last_change":"2024-02-26T12:20:06.843678+0000","last_active":"2024-02-26T12:20:07.840492+0000","last_peered":"2024-02-26T12:20:07.840492+0000","last_clean":"2024-02-26T12:20:07.840492+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:07.840492+0000","last_undegraded":"2024-02-26T12:20:07.840492+0000","last_fullsized":"2024-02-26T12:20:07.840492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352649+0000","last_change":"2024-02-26T12:20:06.850419+0000","last_active":"2024-02-26T12:20:08.352649+0000","last_peered":"2024-02-26T12:20:08.352649+0000","last_clean":"2024-02-26T12:20:08.352649+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:08.352649+0000","last_undegraded":"2024-02-26T12:20:08.352649+0000","last_fullsized":"2024-02-26T12:20:08.352649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353213+0000","last_change":"2024-02-26T12:20:06.846044+0000","last_active":"2024-02-26T12:20:08.353213+0000","last_peered":"2024-02-26T12:20:08.353213+0000","last_clean":"2024-02-26T12:20:08.353213+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:08.353213+0000","last_undegraded":"2024-02-26T12:20:08.353213+0000","last_fullsized":"2024-02-26T12:20:08.353213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353380+0000","last_change":"2024-02-26T12:20:06.849063+0000","last_active":"2024-02-26T12:20:08.353380+0000","last_peered":"2024-02-26T12:20:08.353380+0000","last_clean":"2024-02-26T12:20:08.353380+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:08.353380+0000","last_undegraded":"2024-02-26T12:20:08.353380+0000","last_fullsized":"2024-02-26T12:20:08.353380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353255+0000","last_change":"2024-02-26T12:20:06.854247+0000","last_active":"2024-02-26T12:20:08.353255+0000","last_peered":"2024-02-26T12:20:08.353255+0000","last_clean":"2024-02-26T12:20:08.353255+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:08.353255+0000","last_undegraded":"2024-02-26T12:20:08.353255+0000","last_fullsized":"2024-02-26T12:20:08.353255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352391+0000","last_change":"2024-02-26T12:20:06.847720+0000","last_active":"2024-02-26T12:20:08.352391+0000","last_peered":"2024-02-26T12:20:08.352391+0000","last_clean":"2024-02-26T12:20:08.352391+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:08.352391+0000","last_undegraded":"2024-02-26T12:20:08.352391+0000","last_fullsized":"2024-02-26T12:20:08.352391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:36.567582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841645+0000","last_change":"2024-02-26T12:20:06.835429+0000","last_active":"2024-02-26T12:20:07.841645+0000","last_peered":"2024-02-26T12:20:07.841645+0000","last_clean":"2024-02-26T12:20:07.841645+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:07.841645+0000","last_undegraded":"2024-02-26T12:20:07.841645+0000","last_fullsized":"2024-02-26T12:20:07.841645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:37.928321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841332+0000","last_change":"2024-02-26T12:20:06.849789+0000","last_active":"2024-02-26T12:20:07.841332+0000","last_peered":"2024-02-26T12:20:07.841332+0000","last_clean":"2024-02-26T12:20:07.841332+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:07.841332+0000","last_undegraded":"2024-02-26T12:20:07.841332+0000","last_fullsized":"2024-02-26T12:20:07.841332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:24.470080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840193+0000","last_change":"2024-02-26T12:20:06.840392+0000","last_active":"2024-02-26T12:20:07.840193+0000","last_peered":"2024-02-26T12:20:07.840193+0000","last_clean":"2024-02-26T12:20:07.840193+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:07.840193+0000","last_undegraded":"2024-02-26T12:20:07.840193+0000","last_fullsized":"2024-02-26T12:20:07.840193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:19.601355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840620+0000","last_change":"2024-02-26T12:20:06.838075+0000","last_active":"2024-02-26T12:20:07.840620+0000","last_peered":"2024-02-26T12:20:07.840620+0000","last_clean":"2024-02-26T12:20:07.840620+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:07.840620+0000","last_undegraded":"2024-02-26T12:20:07.840620+0000","last_fullsized":"2024-02-26T12:20:07.840620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352811+0000","last_change":"2024-02-26T12:20:06.844929+0000","last_active":"2024-02-26T12:20:08.352811+0000","last_peered":"2024-02-26T12:20:08.352811+0000","last_clean":"2024-02-26T12:20:08.352811+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:08.352811+0000","last_undegraded":"2024-02-26T12:20:08.352811+0000","last_fullsized":"2024-02-26T12:20:08.352811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:49:40.985045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353454+0000","last_change":"2024-02-26T12:20:06.848784+0000","last_active":"2024-02-26T12:20:08.353454+0000","last_peered":"2024-02-26T12:20:08.353454+0000","last_clean":"2024-02-26T12:20:08.353454+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:08.353454+0000","last_undegraded":"2024-02-26T12:20:08.353454+0000","last_fullsized":"2024-02-26T12:20:08.353454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:06.852296+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:28:41.455138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840972+0000","last_change":"2024-02-26T12:20:06.834398+0000","last_active":"2024-02-26T12:20:07.840972+0000","last_peered":"2024-02-26T12:20:07.840972+0000","last_clean":"2024-02-26T12:20:07.840972+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:07.840972+0000","last_undegraded":"2024-02-26T12:20:07.840972+0000","last_fullsized":"2024-02-26T12:20:07.840972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841814+0000","last_change":"2024-02-26T12:20:06.851836+0000","last_active":"2024-02-26T12:20:07.841814+0000","last_peered":"2024-02-26T12:20:07.841814+0000","last_clean":"2024-02-26T12:20:07.841814+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:07.841814+0000","last_undegraded":"2024-02-26T12:20:07.841814+0000","last_fullsized":"2024-02-26T12:20:07.841814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352646+0000","last_change":"2024-02-26T12:20:06.840747+0000","last_active":"2024-02-26T12:20:08.352646+0000","last_peered":"2024-02-26T12:20:08.352646+0000","last_clean":"2024-02-26T12:20:08.352646+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:08.352646+0000","last_undegraded":"2024-02-26T12:20:08.352646+0000","last_fullsized":"2024-02-26T12:20:08.352646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352534+0000","last_change":"2024-02-26T12:20:06.848793+0000","last_active":"2024-02-26T12:20:08.352534+0000","last_peered":"2024-02-26T12:20:08.352534+0000","last_clean":"2024-02-26T12:20:08.352534+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:08.352534+0000","last_undegraded":"2024-02-26T12:20:08.352534+0000","last_fullsized":"2024-02-26T12:20:08.352534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352385+0000","last_change":"2024-02-26T12:20:06.846528+0000","last_active":"2024-02-26T12:20:08.352385+0000","last_peered":"2024-02-26T12:20:08.352385+0000","last_clean":"2024-02-26T12:20:08.352385+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:08.352385+0000","last_undegraded":"2024-02-26T12:20:08.352385+0000","last_fullsized":"2024-02-26T12:20:08.352385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840475+0000","last_change":"2024-02-26T12:20:06.839103+0000","last_active":"2024-02-26T12:20:07.840475+0000","last_peered":"2024-02-26T12:20:07.840475+0000","last_clean":"2024-02-26T12:20:07.840475+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:07.840475+0000","last_undegraded":"2024-02-26T12:20:07.840475+0000","last_fullsized":"2024-02-26T12:20:07.840475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353090+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:08.353090+0000","last_peered":"2024-02-26T12:20:08.353090+0000","last_clean":"2024-02-26T12:20:08.353090+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:08.353090+0000","last_undegraded":"2024-02-26T12:20:08.353090+0000","last_fullsized":"2024-02-26T12:20:08.353090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353108+0000","last_change":"2024-02-26T12:20:06.844293+0000","last_active":"2024-02-26T12:20:08.353108+0000","last_peered":"2024-02-26T12:20:08.353108+0000","last_clean":"2024-02-26T12:20:08.353108+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:08.353108+0000","last_undegraded":"2024-02-26T12:20:08.353108+0000","last_fullsized":"2024-02-26T12:20:08.353108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840380+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:07.840380+0000","last_peered":"2024-02-26T12:20:07.840380+0000","last_clean":"2024-02-26T12:20:07.840380+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:07.840380+0000","last_undegraded":"2024-02-26T12:20:07.840380+0000","last_fullsized":"2024-02-26T12:20:07.840380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842032+0000","last_change":"2024-02-26T12:20:06.851045+0000","last_active":"2024-02-26T12:20:07.842032+0000","last_peered":"2024-02-26T12:20:07.842032+0000","last_clean":"2024-02-26T12:20:07.842032+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:07.842032+0000","last_undegraded":"2024-02-26T12:20:07.842032+0000","last_fullsized":"2024-02-26T12:20:07.842032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353347+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:08.353347+0000","last_peered":"2024-02-26T12:20:08.353347+0000","last_clean":"2024-02-26T12:20:08.353347+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:08.353347+0000","last_undegraded":"2024-02-26T12:20:08.353347+0000","last_fullsized":"2024-02-26T12:20:08.353347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352989+0000","last_change":"2024-02-26T12:20:06.839258+0000","last_active":"2024-02-26T12:20:08.352989+0000","last_peered":"2024-02-26T12:20:08.352989+0000","last_clean":"2024-02-26T12:20:08.352989+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:08.352989+0000","last_undegraded":"2024-02-26T12:20:08.352989+0000","last_fullsized":"2024-02-26T12:20:08.352989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:11.744361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352472+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:08.352472+0000","last_peered":"2024-02-26T12:20:08.352472+0000","last_clean":"2024-02-26T12:20:08.352472+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:08.352472+0000","last_undegraded":"2024-02-26T12:20:08.352472+0000","last_fullsized":"2024-02-26T12:20:08.352472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:38:38.644589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:06.846106+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841764+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:07.841764+0000","last_peered":"2024-02-26T12:20:07.841764+0000","last_clean":"2024-02-26T12:20:07.841764+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:07.841764+0000","last_undegraded":"2024-02-26T12:20:07.841764+0000","last_fullsized":"2024-02-26T12:20:07.841764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840887+0000","last_change":"2024-02-26T12:20:06.835746+0000","last_active":"2024-02-26T12:20:07.840887+0000","last_peered":"2024-02-26T12:20:07.840887+0000","last_clean":"2024-02-26T12:20:07.840887+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:07.840887+0000","last_undegraded":"2024-02-26T12:20:07.840887+0000","last_fullsized":"2024-02-26T12:20:07.840887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841583+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:07.841583+0000","last_peered":"2024-02-26T12:20:07.841583+0000","last_clean":"2024-02-26T12:20:07.841583+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:07.841583+0000","last_undegraded":"2024-02-26T12:20:07.841583+0000","last_fullsized":"2024-02-26T12:20:07.841583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840817+0000","last_change":"2024-02-26T12:20:06.840340+0000","last_active":"2024-02-26T12:20:07.840817+0000","last_peered":"2024-02-26T12:20:07.840817+0000","last_clean":"2024-02-26T12:20:07.840817+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:07.840817+0000","last_undegraded":"2024-02-26T12:20:07.840817+0000","last_fullsized":"2024-02-26T12:20:07.840817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:55.795288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353065+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:08.353065+0000","last_peered":"2024-02-26T12:20:08.353065+0000","last_clean":"2024-02-26T12:20:08.353065+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:08.353065+0000","last_undegraded":"2024-02-26T12:20:08.353065+0000","last_fullsized":"2024-02-26T12:20:08.353065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:11.880880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352269+0000","last_change":"2024-02-26T12:20:06.838655+0000","last_active":"2024-02-26T12:20:08.352269+0000","last_peered":"2024-02-26T12:20:08.352269+0000","last_clean":"2024-02-26T12:20:08.352269+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:08.352269+0000","last_undegraded":"2024-02-26T12:20:08.352269+0000","last_fullsized":"2024-02-26T12:20:08.352269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840460+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:07.840460+0000","last_peered":"2024-02-26T12:20:07.840460+0000","last_clean":"2024-02-26T12:20:07.840460+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:07.840460+0000","last_undegraded":"2024-02-26T12:20:07.840460+0000","last_fullsized":"2024-02-26T12:20:07.840460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840823+0000","last_change":"2024-02-26T12:20:06.851695+0000","last_active":"2024-02-26T12:20:07.840823+0000","last_peered":"2024-02-26T12:20:07.840823+0000","last_clean":"2024-02-26T12:20:07.840823+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:07.840823+0000","last_undegraded":"2024-02-26T12:20:07.840823+0000","last_fullsized":"2024-02-26T12:20:07.840823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353626+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:08.353626+0000","last_peered":"2024-02-26T12:20:08.353626+0000","last_clean":"2024-02-26T12:20:08.353626+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:08.353626+0000","last_undegraded":"2024-02-26T12:20:08.353626+0000","last_fullsized":"2024-02-26T12:20:08.353626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353574+0000","last_change":"2024-02-26T12:20:06.852393+0000","last_active":"2024-02-26T12:20:08.353574+0000","last_peered":"2024-02-26T12:20:08.353574+0000","last_clean":"2024-02-26T12:20:08.353574+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:08.353574+0000","last_undegraded":"2024-02-26T12:20:08.353574+0000","last_fullsized":"2024-02-26T12:20:08.353574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840482+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:07.840482+0000","last_peered":"2024-02-26T12:20:07.840482+0000","last_clean":"2024-02-26T12:20:07.840482+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:07.840482+0000","last_undegraded":"2024-02-26T12:20:07.840482+0000","last_fullsized":"2024-02-26T12:20:07.840482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352771+0000","last_change":"2024-02-26T12:20:06.849481+0000","last_active":"2024-02-26T12:20:08.352771+0000","last_peered":"2024-02-26T12:20:08.352771+0000","last_clean":"2024-02-26T12:20:08.352771+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:08.352771+0000","last_undegraded":"2024-02-26T12:20:08.352771+0000","last_fullsized":"2024-02-26T12:20:08.352771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841138+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:07.841138+0000","last_peered":"2024-02-26T12:20:07.841138+0000","last_clean":"2024-02-26T12:20:07.841138+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:07.841138+0000","last_undegraded":"2024-02-26T12:20:07.841138+0000","last_fullsized":"2024-02-26T12:20:07.841138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841041+0000","last_change":"2024-02-26T12:20:06.834421+0000","last_active":"2024-02-26T12:20:07.841041+0000","last_peered":"2024-02-26T12:20:07.841041+0000","last_clean":"2024-02-26T12:20:07.841041+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:07.841041+0000","last_undegraded":"2024-02-26T12:20:07.841041+0000","last_fullsized":"2024-02-26T12:20:07.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352871+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:08.352871+0000","last_peered":"2024-02-26T12:20:08.352871+0000","last_clean":"2024-02-26T12:20:08.352871+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:08.352871+0000","last_undegraded":"2024-02-26T12:20:08.352871+0000","last_fullsized":"2024-02-26T12:20:08.352871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353078+0000","last_change":"2024-02-26T12:20:06.841973+0000","last_active":"2024-02-26T12:20:08.353078+0000","last_peered":"2024-02-26T12:20:08.353078+0000","last_clean":"2024-02-26T12:20:08.353078+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:08.353078+0000","last_undegraded":"2024-02-26T12:20:08.353078+0000","last_fullsized":"2024-02-26T12:20:08.353078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:04:12.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841896+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:07.841896+0000","last_peered":"2024-02-26T12:20:07.841896+0000","last_clean":"2024-02-26T12:20:07.841896+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:07.841896+0000","last_undegraded":"2024-02-26T12:20:07.841896+0000","last_fullsized":"2024-02-26T12:20:07.841896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353613+0000","last_change":"2024-02-26T12:20:06.849714+0000","last_active":"2024-02-26T12:20:08.353613+0000","last_peered":"2024-02-26T12:20:08.353613+0000","last_clean":"2024-02-26T12:20:08.353613+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:08.353613+0000","last_undegraded":"2024-02-26T12:20:08.353613+0000","last_fullsized":"2024-02-26T12:20:08.353613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352543+0000","last_change":"2024-02-26T12:20:06.846095+0000","last_active":"2024-02-26T12:20:08.352543+0000","last_peered":"2024-02-26T12:20:08.352543+0000","last_clean":"2024-02-26T12:20:08.352543+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:08.352543+0000","last_undegraded":"2024-02-26T12:20:08.352543+0000","last_fullsized":"2024-02-26T12:20:08.352543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353073+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:08.353073+0000","last_peered":"2024-02-26T12:20:08.353073+0000","last_clean":"2024-02-26T12:20:08.353073+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:08.353073+0000","last_undegraded":"2024-02-26T12:20:08.353073+0000","last_fullsized":"2024-02-26T12:20:08.353073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:49.632494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352570+0000","last_change":"2024-02-26T12:20:06.844305+0000","last_active":"2024-02-26T12:20:08.352570+0000","last_peered":"2024-02-26T12:20:08.352570+0000","last_clean":"2024-02-26T12:20:08.352570+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:08.352570+0000","last_undegraded":"2024-02-26T12:20:08.352570+0000","last_fullsized":"2024-02-26T12:20:08.352570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:34.562401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841724+0000","last_change":"2024-02-26T12:20:06.836689+0000","last_active":"2024-02-26T12:20:07.841724+0000","last_peered":"2024-02-26T12:20:07.841724+0000","last_clean":"2024-02-26T12:20:07.841724+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:07.841724+0000","last_undegraded":"2024-02-26T12:20:07.841724+0000","last_fullsized":"2024-02-26T12:20:07.841724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352972+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:08.352972+0000","last_peered":"2024-02-26T12:20:08.352972+0000","last_clean":"2024-02-26T12:20:08.352972+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:08.352972+0000","last_undegraded":"2024-02-26T12:20:08.352972+0000","last_fullsized":"2024-02-26T12:20:08.352972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841468+0000","last_change":"2024-02-26T12:20:06.847756+0000","last_active":"2024-02-26T12:20:07.841468+0000","last_peered":"2024-02-26T12:20:07.841468+0000","last_clean":"2024-02-26T12:20:07.841468+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:07.841468+0000","last_undegraded":"2024-02-26T12:20:07.841468+0000","last_fullsized":"2024-02-26T12:20:07.841468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841807+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:07.841807+0000","last_peered":"2024-02-26T12:20:07.841807+0000","last_clean":"2024-02-26T12:20:07.841807+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:07.841807+0000","last_undegraded":"2024-02-26T12:20:07.841807+0000","last_fullsized":"2024-02-26T12:20:07.841807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352439+0000","last_change":"2024-02-26T12:20:06.851971+0000","last_active":"2024-02-26T12:20:08.352439+0000","last_peered":"2024-02-26T12:20:08.352439+0000","last_clean":"2024-02-26T12:20:08.352439+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:08.352439+0000","last_undegraded":"2024-02-26T12:20:08.352439+0000","last_fullsized":"2024-02-26T12:20:08.352439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841761+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:07.841761+0000","last_peered":"2024-02-26T12:20:07.841761+0000","last_clean":"2024-02-26T12:20:07.841761+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:07.841761+0000","last_undegraded":"2024-02-26T12:20:07.841761+0000","last_fullsized":"2024-02-26T12:20:07.841761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352170+0000","last_change":"2024-02-26T12:20:06.841194+0000","last_active":"2024-02-26T12:20:08.352170+0000","last_peered":"2024-02-26T12:20:08.352170+0000","last_clean":"2024-02-26T12:20:08.352170+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:08.352170+0000","last_undegraded":"2024-02-26T12:20:08.352170+0000","last_fullsized":"2024-02-26T12:20:08.352170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:36.378565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842034+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:07.842034+0000","last_peered":"2024-02-26T12:20:07.842034+0000","last_clean":"2024-02-26T12:20:07.842034+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:07.842034+0000","last_undegraded":"2024-02-26T12:20:07.842034+0000","last_fullsized":"2024-02-26T12:20:07.842034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.841086+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:45.667456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840347+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:07.840347+0000","last_peered":"2024-02-26T12:20:07.840347+0000","last_clean":"2024-02-26T12:20:07.840347+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:07.840347+0000","last_undegraded":"2024-02-26T12:20:07.840347+0000","last_fullsized":"2024-02-26T12:20:07.840347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352358+0000","last_change":"2024-02-26T12:20:06.847035+0000","last_active":"2024-02-26T12:20:08.352358+0000","last_peered":"2024-02-26T12:20:08.352358+0000","last_clean":"2024-02-26T12:20:08.352358+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:08.352358+0000","last_undegraded":"2024-02-26T12:20:08.352358+0000","last_fullsized":"2024-02-26T12:20:08.352358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:44.444191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352952+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:08.352952+0000","last_peered":"2024-02-26T12:20:08.352952+0000","last_clean":"2024-02-26T12:20:08.352952+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:08.352952+0000","last_undegraded":"2024-02-26T12:20:08.352952+0000","last_fullsized":"2024-02-26T12:20:08.352952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.351951+0000","last_change":"2024-02-26T12:20:06.836131+0000","last_active":"2024-02-26T12:20:08.351951+0000","last_peered":"2024-02-26T12:20:08.351951+0000","last_clean":"2024-02-26T12:20:08.351951+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:08.351951+0000","last_undegraded":"2024-02-26T12:20:08.351951+0000","last_fullsized":"2024-02-26T12:20:08.351951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:37.734794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841367+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:07.841367+0000","last_peered":"2024-02-26T12:20:07.841367+0000","last_clean":"2024-02-26T12:20:07.841367+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:07.841367+0000","last_undegraded":"2024-02-26T12:20:07.841367+0000","last_fullsized":"2024-02-26T12:20:07.841367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352683+0000","last_change":"2024-02-26T12:20:06.843136+0000","last_active":"2024-02-26T12:20:08.352683+0000","last_peered":"2024-02-26T12:20:08.352683+0000","last_clean":"2024-02-26T12:20:08.352683+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:08.352683+0000","last_undegraded":"2024-02-26T12:20:08.352683+0000","last_fullsized":"2024-02-26T12:20:08.352683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840292+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:07.840292+0000","last_peered":"2024-02-26T12:20:07.840292+0000","last_clean":"2024-02-26T12:20:07.840292+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:07.840292+0000","last_undegraded":"2024-02-26T12:20:07.840292+0000","last_fullsized":"2024-02-26T12:20:07.840292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.843988+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:15.222912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353068+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:08.353068+0000","last_peered":"2024-02-26T12:20:08.353068+0000","last_clean":"2024-02-26T12:20:08.353068+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:08.353068+0000","last_undegraded":"2024-02-26T12:20:08.353068+0000","last_fullsized":"2024-02-26T12:20:08.353068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841445+0000","last_change":"2024-02-26T12:20:06.846498+0000","last_active":"2024-02-26T12:20:07.841445+0000","last_peered":"2024-02-26T12:20:07.841445+0000","last_clean":"2024-02-26T12:20:07.841445+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:07.841445+0000","last_undegraded":"2024-02-26T12:20:07.841445+0000","last_fullsized":"2024-02-26T12:20:07.841445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840598+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:07.840598+0000","last_peered":"2024-02-26T12:20:07.840598+0000","last_clean":"2024-02-26T12:20:07.840598+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:07.840598+0000","last_undegraded":"2024-02-26T12:20:07.840598+0000","last_fullsized":"2024-02-26T12:20:07.840598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840309+0000","last_change":"2024-02-26T12:20:06.840249+0000","last_active":"2024-02-26T12:20:07.840309+0000","last_peered":"2024-02-26T12:20:07.840309+0000","last_clean":"2024-02-26T12:20:07.840309+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:07.840309+0000","last_undegraded":"2024-02-26T12:20:07.840309+0000","last_fullsized":"2024-02-26T12:20:07.840309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352525+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:08.352525+0000","last_peered":"2024-02-26T12:20:08.352525+0000","last_clean":"2024-02-26T12:20:08.352525+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:08.352525+0000","last_undegraded":"2024-02-26T12:20:08.352525+0000","last_fullsized":"2024-02-26T12:20:08.352525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352648+0000","last_change":"2024-02-26T12:20:06.844149+0000","last_active":"2024-02-26T12:20:08.352648+0000","last_peered":"2024-02-26T12:20:08.352648+0000","last_clean":"2024-02-26T12:20:08.352648+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:08.352648+0000","last_undegraded":"2024-02-26T12:20:08.352648+0000","last_fullsized":"2024-02-26T12:20:08.352648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840470+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:07.840470+0000","last_peered":"2024-02-26T12:20:07.840470+0000","last_clean":"2024-02-26T12:20:07.840470+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:07.840470+0000","last_undegraded":"2024-02-26T12:20:07.840470+0000","last_fullsized":"2024-02-26T12:20:07.840470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840357+0000","last_change":"2024-02-26T12:20:06.846886+0000","last_active":"2024-02-26T12:20:07.840357+0000","last_peered":"2024-02-26T12:20:07.840357+0000","last_clean":"2024-02-26T12:20:07.840357+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:07.840357+0000","last_undegraded":"2024-02-26T12:20:07.840357+0000","last_fullsized":"2024-02-26T12:20:07.840357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353099+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:08.353099+0000","last_peered":"2024-02-26T12:20:08.353099+0000","last_clean":"2024-02-26T12:20:08.353099+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:08.353099+0000","last_undegraded":"2024-02-26T12:20:08.353099+0000","last_fullsized":"2024-02-26T12:20:08.353099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352712+0000","last_change":"2024-02-26T12:20:06.849839+0000","last_active":"2024-02-26T12:20:08.352712+0000","last_peered":"2024-02-26T12:20:08.352712+0000","last_clean":"2024-02-26T12:20:08.352712+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:08.352712+0000","last_undegraded":"2024-02-26T12:20:08.352712+0000","last_fullsized":"2024-02-26T12:20:08.352712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841436+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:07.841436+0000","last_peered":"2024-02-26T12:20:07.841436+0000","last_clean":"2024-02-26T12:20:07.841436+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:07.841436+0000","last_undegraded":"2024-02-26T12:20:07.841436+0000","last_fullsized":"2024-02-26T12:20:07.841436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840423+0000","last_change":"2024-02-26T12:20:06.849696+0000","last_active":"2024-02-26T12:20:07.840423+0000","last_peered":"2024-02-26T12:20:07.840423+0000","last_clean":"2024-02-26T12:20:07.840423+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:07.840423+0000","last_undegraded":"2024-02-26T12:20:07.840423+0000","last_fullsized":"2024-02-26T12:20:07.840423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352941+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:08.352941+0000","last_peered":"2024-02-26T12:20:08.352941+0000","last_clean":"2024-02-26T12:20:08.352941+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:08.352941+0000","last_undegraded":"2024-02-26T12:20:08.352941+0000","last_fullsized":"2024-02-26T12:20:08.352941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352828+0000","last_change":"2024-02-26T12:20:06.839596+0000","last_active":"2024-02-26T12:20:08.352828+0000","last_peered":"2024-02-26T12:20:08.352828+0000","last_clean":"2024-02-26T12:20:08.352828+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:08.352828+0000","last_undegraded":"2024-02-26T12:20:08.352828+0000","last_fullsized":"2024-02-26T12:20:08.352828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352875+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:08.352875+0000","last_peered":"2024-02-26T12:20:08.352875+0000","last_clean":"2024-02-26T12:20:08.352875+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:08.352875+0000","last_undegraded":"2024-02-26T12:20:08.352875+0000","last_fullsized":"2024-02-26T12:20:08.352875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352681+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:08.352681+0000","last_peered":"2024-02-26T12:20:08.352681+0000","last_clean":"2024-02-26T12:20:08.352681+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:08.352681+0000","last_undegraded":"2024-02-26T12:20:08.352681+0000","last_fullsized":"2024-02-26T12:20:08.352681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:14.486 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-26T12:20:14.486 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-02-26T12:20:14.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.645+0000 7fe01b4a6640 1 Processor -- start 2024-02-26T12:20:14.630 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.645+0000 7fe01b4a6640 1 -- start start 2024-02-26T12:20:14.633 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe01b4a6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe0140cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe01b4a6640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140cc6c0 con 0x7fe01406bb70 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe01b4a6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140cfd00 con 0x7fe0140ca570 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe01b4a6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140cc100 con 0x7fe0140cdaf0 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe019a43640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe01406bb70 0x7fe0140cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54748/0 (socket says 172.21.15.113:54748) 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe019a43640 1 -- 172.21.15.113:0/4058630048 learned_addr learned my addr 172.21.15.113:0/4058630048 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341147029 0 0) 0x7fe0140cc6c0 con 0x7fe01406bb70 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe000003520 con 0x7fe01406bb70 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe019242640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe0140cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227099144 0 0) 0x7fe000003520 con 0x7fe01406bb70 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 msgr2=0x7fe0140cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.634 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe0140cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 >> v1:172.21.15.152:6789/0 conn(0x7fe0140ca570 legacy=0x7fe01406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140cc3e0 con 0x7fe01406bb70 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe00c0019f0 con 0x7fe01406bb70 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 >> v1:172.21.15.113:6789/0 conn(0x7fe01406bb70 legacy=0x7fe0140cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000039e0 0x7fe000003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe000004800 0x7fe000004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe00000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140cc100 con 0x7fe000004800 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000005520 con 0x7fe0000039e0 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.646+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00000bf00 con 0x7fe0140cdaf0 2024-02-26T12:20:14.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe000004800 0x7fe000004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe019242640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000039e0 0x7fe000003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe019a43640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe00000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 -- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 msgr2=0x7fe00000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe0140cdaf0 0x7fe00000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 -- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000039e0 msgr2=0x7fe000003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0000039e0 0x7fe000003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.647+0000 7fe018a41640 1 -- 172.21.15.113:0/4058630048 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000003520 con 0x7fe000004800 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe018a41640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe000004800 0x7fe000004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe004001750 tx=0x7fe000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930bd81110ff8a4a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004001370 con 0x7fe000004800 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040052d0 con 0x7fe000004800 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe00bfff640 1 -- 172.21.15.113:0/4058630048 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004003830 con 0x7fe000004800 2024-02-26T12:20:14.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 -- 172.21.15.113:0/4058630048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe000004800 msgr2=0x7fe000004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/4058630048 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe000004800 0x7fe000004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe004001750 tx=0x7fe000005830 comp rx=0 tx=0).stop 2024-02-26T12:20:14.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe019a43640 1 -- 172.21.15.113:0/4058630048 reap_dead start 2024-02-26T12:20:14.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 -- 172.21.15.113:0/4058630048 shutdown_connections 2024-02-26T12:20:14.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 -- 172.21.15.113:0/4058630048 >> 172.21.15.113:0/4058630048 conn(0x7fe0140cc9a0 msgr2=0x7fe0140ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:14.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 -- 172.21.15.113:0/4058630048 shutdown_connections 2024-02-26T12:20:14.640 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.648+0000 7fe01b4a6640 1 -- 172.21.15.113:0/4058630048 wait complete. 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.649+0000 7fe01b4a6640 1 Processor -- start 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 -- start start 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe000004800 0x7fe0141f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe01409e510 0x7fe01406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140ce5e0 con 0x7fe01409e990 2024-02-26T12:20:14.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406e160 con 0x7fe000004800 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe01b4a6640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140ce760 con 0x7fe01409e510 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe019a43640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe019a43640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59428/0 (socket says 172.21.15.113:59428) 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.650+0000 7fe019a43640 1 -- 172.21.15.113:0/3817849319 learned_addr learned my addr 172.21.15.113:0/3817849319 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 -- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe01409e510 msgr2=0x7fe01406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe01409e510 0x7fe01406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 -- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe000004800 msgr2=0x7fe0141f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe000004800 0x7fe0141f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 -- 172.21.15.113:0/3817849319 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0141f7560 con 0x7fe01409e990 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe019a43640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe014067240 tx=0x7fe00c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00ab10 con 0x7fe01409e990 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c018070 con 0x7fe01409e990 2024-02-26T12:20:14.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0133f0 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0141f7840 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.651+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0141f7e00 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.652+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0140c8780 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.652+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe00c013590 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.653+0000 7fe009ffb640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 0x7fdff806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.653+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe00c08a6e0 con 0x7fe01409e990 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.653+0000 7fe019242640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 0x7fdff806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.653+0000 7fe019242640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 0x7fdff806d9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ab0 tx=0x7fe0100095d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:14.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.657+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe00c059560 con 0x7fe01409e990 2024-02-26T12:20:14.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.895+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe014074a50 con 0x7fe01409e990 2024-02-26T12:20:14.882 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.897+0000 7fe009ffb640 1 -- 172.21.15.113:0/3817849319 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe00c058e60 con 0x7fe01409e990 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQCNgdxlPw+IHxAAOkKN2ANdXBNLAJL0n0jDGw== 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stdout: caps mds = "allow" 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stdout: caps mon = "allow r" 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-02-26T12:20:14.883 INFO:teuthology.orchestra.run.smithi113.stderr:updated caps for client.0 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 msgr2=0x7fdff806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 0x7fdff806d9c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ab0 tx=0x7fe0100095d0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 msgr2=0x7fe01406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe014067240 tx=0x7fe00c007bd0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 shutdown_connections 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdff806b500 0x7fdff806d9c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe01409e990 0x7fe01406e820 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe01409e510 0x7fe01406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.899+0000 7fe01b4a6640 1 --2- 172.21.15.113:0/3817849319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe000004800 0x7fe0141f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.900+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 >> 172.21.15.113:0/3817849319 conn(0x7fe0140cc9a0 msgr2=0x7fe0140b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:14.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.900+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 shutdown_connections 2024-02-26T12:20:14.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:14.900+0000 7fe01b4a6640 1 -- 172.21.15.113:0/3817849319 wait complete. 2024-02-26T12:20:14.895 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:20:14.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.011+0000 7f17ea35e640 1 Processor -- start 2024-02-26T12:20:14.996 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.011+0000 7f17ea35e640 1 -- start start 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17ea35e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f17e406eb70 0x7f17e40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17ea35e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17e4071ce0 0x7f17e40cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17ea35e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e40cf3a0 con 0x7f17e40711f0 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17ea35e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e4145840 con 0x7f17e4071ce0 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17ea35e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40cf670 con 0x7f17e406eb70 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17e4071ce0 0x7f17e40cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f17e4071ce0 0x7f17e40cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59440/0 (socket says 172.21.15.113:59440) 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 -- 172.21.15.113:0/2509527589 learned_addr learned my addr 172.21.15.113:0/2509527589 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 -- 172.21.15.113:0/2509527589 >> v2:172.21.15.152:3300/0 conn(0x7f17e406eb70 msgr2=0x7f17e40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e37fe640 1 --2- 172.21.15.113:0/2509527589 >> v2:172.21.15.152:3300/0 conn(0x7f17e406eb70 0x7f17e40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:14.998 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 --2- 172.21.15.113:0/2509527589 >> v2:172.21.15.152:3300/0 conn(0x7f17e406eb70 0x7f17e40ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:14.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 -- 172.21.15.113:0/2509527589 >> v1:172.21.15.152:6789/0 conn(0x7f17e40711f0 legacy=0x7f17e40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:14.999 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.012+0000 7f17e88fb640 1 -- 172.21.15.113:0/2509527589 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40cf950 con 0x7f17e4071ce0 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.013+0000 7f17e88fb640 1 --2- 172.21.15.113:0/2509527589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e4071ce0 0x7f17e40cee60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f17e40b4a40 tx=0x7f17dc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c57cd56ff9a9f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.013+0000 7f17e2ffd640 1 -- 172.21.15.113:0/2509527589 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc02c9f0 con 0x7f17e4071ce0 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.013+0000 7f17e2ffd640 1 -- 172.21.15.113:0/2509527589 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc02cb90 con 0x7f17e4071ce0 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.013+0000 7f17e2ffd640 1 -- 172.21.15.113:0/2509527589 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0343f0 con 0x7f17e4071ce0 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 -- 172.21.15.113:0/2509527589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e4071ce0 msgr2=0x7f17e40cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 --2- 172.21.15.113:0/2509527589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e4071ce0 0x7f17e40cee60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f17e40b4a40 tx=0x7f17dc02be50 comp rx=0 tx=0).stop 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 -- 172.21.15.113:0/2509527589 shutdown_connections 2024-02-26T12:20:15.000 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 --2- 172.21.15.113:0/2509527589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e4071ce0 0x7f17e40cee60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 --2- 172.21.15.113:0/2509527589 >> v2:172.21.15.152:3300/0 conn(0x7f17e406eb70 0x7f17e40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 -- 172.21.15.113:0/2509527589 >> 172.21.15.113:0/2509527589 conn(0x7f17e406ab50 msgr2=0x7f17e406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 -- 172.21.15.113:0/2509527589 shutdown_connections 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.014+0000 7f17ea35e640 1 -- 172.21.15.113:0/2509527589 wait complete. 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.015+0000 7f17ea35e640 1 Processor -- start 2024-02-26T12:20:15.001 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.015+0000 7f17ea35e640 1 -- start start 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17e40711f0 0x7f17e4142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17e4071ce0 0x7f17e413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4165680 con 0x7f17e406eb70 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40cff10 con 0x7f17e40711f0 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17ea35e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4165800 con 0x7f17e4071ce0 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59446/0 (socket says 172.21.15.113:59446) 2024-02-26T12:20:15.004 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 -- 172.21.15.113:0/3003958863 learned_addr learned my addr 172.21.15.113:0/3003958863 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e88fb640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17e4071ce0 0x7f17e413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e37fe640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17e40711f0 0x7f17e4142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 -- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17e4071ce0 msgr2=0x7f17e413db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17e4071ce0 0x7f17e413db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 -- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17e40711f0 msgr2=0x7f17e4142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17e40711f0 0x7f17e4142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.016+0000 7f17e3fff640 1 -- 172.21.15.113:0/3003958863 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e413e650 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17e3fff640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c430 tx=0x7f17d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4011790 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4017070 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4011bb0 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e413e990 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.017+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e413f6d0 con 0x7f17e406eb70 2024-02-26T12:20:15.005 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.018+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e4074a50 con 0x7f17e406eb70 2024-02-26T12:20:15.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.018+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f17d401c460 con 0x7f17e406eb70 2024-02-26T12:20:15.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.019+0000 7f17e0ff9640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 0x7f17d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.019+0000 7f17e37fe640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 0x7f17d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.019+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17d408a030 con 0x7f17e406eb70 2024-02-26T12:20:15.006 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.019+0000 7f17e37fe640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 0x7f17d006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006fd0 tx=0x7f17d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.008 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.023+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17e413e990 con 0x7f17e406eb70 2024-02-26T12:20:15.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.225+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17e413eb70 con 0x7f17e406eb70 2024-02-26T12:20:15.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.225+0000 7f17e0ff9640 1 -- 172.21.15.113:0/3003958863 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f17d4058f40 con 0x7f17e406eb70 2024-02-26T12:20:15.212 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:15.212 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/584883378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":584883378},{"type":"v1","addr":"172.21.15.113:6837","nonce":584883378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6834/125186533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":125186533},{"type":"v1","addr":"172.21.15.152:6834","nonce":125186533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/963040340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":963040340},{"type":"v1","addr":"172.21.15.152:6835","nonce":963040340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:20:06.176062+0000","modified":"2024-02-26T12:20:08.174361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6835/2648726034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2648726034},{"type":"v1","addr":"172.21.15.113:6835","nonce":2648726034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-26T12:20:15.212 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 14 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 msgr2=0x7f17d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 0x7f17d006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006fd0 tx=0x7f17d8008040 comp rx=0 tx=0).stop 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 msgr2=0x7f17e415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c430 tx=0x7f17d400c8f0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 shutdown_connections 2024-02-26T12:20:15.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f17d006b4d0 0x7f17d006d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f17e4071ce0 0x7f17e413db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17e40711f0 0x7f17e4142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 --2- 172.21.15.113:0/3003958863 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17e406eb70 0x7f17e415ad60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.227+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 >> 172.21.15.113:0/3003958863 conn(0x7f17e406ab50 msgr2=0x7f17e40b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.228+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 shutdown_connections 2024-02-26T12:20:15.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.228+0000 7f17ea35e640 1 -- 172.21.15.113:0/3003958863 wait complete. 2024-02-26T12:20:15.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-26T12:20:06.176062+0000', 'modified': '2024-02-26T12:20:08.174361+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5019}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5019': {'gid': 5019, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.113:6835/2648726034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.113:6834', 'nonce': 2648726034}, {'type': 'v1', 'addr': '172.21.15.113:6835', 'nonce': 2648726034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-26T12:20:15.628 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-26T12:20:15.628 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-02-26T12:20:15.731 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 Processor -- start 2024-02-26T12:20:15.731 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 -- start start 2024-02-26T12:20:15.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc9900cdaf0 0x7fc9900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9900ca570 0x7fc99006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc99006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9900cc6c0 con 0x7fc9900ca570 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9900cfd00 con 0x7fc9900cdaf0 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.745+0000 7fc996d1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900cc100 con 0x7fc99006df90 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9900ca570 0x7fc99006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc9900ca570 0x7fc99006da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59448/0 (socket says 172.21.15.113:59448) 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 -- 172.21.15.113:0/1429130051 learned_addr learned my addr 172.21.15.113:0/1429130051 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 -- 172.21.15.113:0/1429130051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 msgr2=0x7fc99006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 --2- 172.21.15.113:0/1429130051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc99006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 -- 172.21.15.113:0/1429130051 >> v2:172.21.15.152:3300/0 conn(0x7fc9900cdaf0 msgr2=0x7fc9900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 --2- 172.21.15.113:0/1429130051 >> v2:172.21.15.152:3300/0 conn(0x7fc9900cdaf0 0x7fc9900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 -- 172.21.15.113:0/1429130051 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900cc3e0 con 0x7fc9900ca570 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.746+0000 7fc98ffff640 1 --2- 172.21.15.113:0/1429130051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900ca570 0x7fc99006da50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc99009df00 tx=0x7fc97802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b9d7f7a93cc224 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc98f7fe640 1 -- 172.21.15.113:0/1429130051 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978038070 con 0x7fc9900ca570 2024-02-26T12:20:15.734 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc98f7fe640 1 -- 172.21.15.113:0/1429130051 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97802f050 con 0x7fc9900ca570 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc98f7fe640 1 -- 172.21.15.113:0/1429130051 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978031970 con 0x7fc9900ca570 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 -- 172.21.15.113:0/1429130051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900ca570 msgr2=0x7fc99006da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 --2- 172.21.15.113:0/1429130051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900ca570 0x7fc99006da50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc99009df00 tx=0x7fc97802b7f0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 -- 172.21.15.113:0/1429130051 shutdown_connections 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 --2- 172.21.15.113:0/1429130051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc99006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 --2- 172.21.15.113:0/1429130051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900ca570 0x7fc99006da50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 --2- 172.21.15.113:0/1429130051 >> v2:172.21.15.152:3300/0 conn(0x7fc9900cdaf0 0x7fc9900cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 -- 172.21.15.113:0/1429130051 >> 172.21.15.113:0/1429130051 conn(0x7fc9900cc9a0 msgr2=0x7fc9900ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 -- 172.21.15.113:0/1429130051 shutdown_connections 2024-02-26T12:20:15.735 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.747+0000 7fc996d1e640 1 -- 172.21.15.113:0/1429130051 wait complete. 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.748+0000 7fc996d1e640 1 Processor -- start 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.748+0000 7fc996d1e640 1 -- start start 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc9900c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9900ca570 0x7fc9900c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99006c230 con 0x7fc9900cdaf0 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99006c0b0 con 0x7fc9900ca570 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc996d1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99006c3b0 con 0x7fc99006df90 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc9952bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc9952bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59458/0 (socket says 172.21.15.113:59458) 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.749+0000 7fc9952bb640 1 -- 172.21.15.113:0/2814018420 learned_addr learned my addr 172.21.15.113:0/2814018420 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc994aba640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc9900c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc98ffff640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9900ca570 0x7fc9900c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 -- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 msgr2=0x7fc9900c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc9900c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 -- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9900ca570 msgr2=0x7fc9900c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9900ca570 0x7fc9900c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 -- 172.21.15.113:0/2814018420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900c4710 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc9952bb640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc98000b410 tx=0x7fc98000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc98d7fa640 1 -- 172.21.15.113:0/2814018420 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980015020 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc98d7fa640 1 -- 172.21.15.113:0/2814018420 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc980011830 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900c49f0 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc98d7fa640 1 -- 172.21.15.113:0/2814018420 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980011c20 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.750+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900c4fb0 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.751+0000 7fc98d7fa640 1 -- 172.21.15.113:0/2814018420 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc980018020 con 0x7fc9900cdaf0 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.752+0000 7fc98d7fa640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 0x7fc97006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.752+0000 7fc98d7fa640 1 -- 172.21.15.113:0/2814018420 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc98008a0f0 con 0x7fc9900cdaf0 2024-02-26T12:20:15.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.752+0000 7fc994aba640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 0x7fc97006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.752+0000 7fc994aba640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 0x7fc97006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9900c9920 tx=0x7fc988007310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 Processor -- start 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 -- start start 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 0x555c2ac8b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 0x555c2acb5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.746 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2abef680 con 0x555c2ac85840 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2ab98a30 con 0x555c2acb55d0 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c2abeb720 con 0x555c2ac89890 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc994aba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc994aba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59474/0 (socket says 172.21.15.113:59474) 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.753+0000 7fc994aba640 1 -- 172.21.15.113:0/4180526091 learned_addr learned my addr 172.21.15.113:0/4180526091 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc98ffff640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 0x555c2ac8b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc9952bb640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 0x555c2acb5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 -- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 msgr2=0x555c2ac8b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 0x555c2ac8b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 -- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 msgr2=0x555c2acb5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 0x555c2acb5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 -- 172.21.15.113:0/4180526091 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c2abb6f00 con 0x555c2ac85840 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc98ffff640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 0x555c2ac8b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc9952bb640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 0x555c2acb5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:15.747 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc994aba640 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc98800cfc0 tx=0x7fc98800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238c08816ed5200c server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc9867fc640 1 -- 172.21.15.113:0/4180526091 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988023070 con 0x555c2ac85840 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc9867fc640 1 -- 172.21.15.113:0/4180526091 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011840 con 0x555c2ac85840 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.754+0000 7fc9867fc640 1 -- 172.21.15.113:0/4180526091 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011bf0 con 0x555c2ac85840 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- 172.21.15.113:0/4180526091 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 msgr2=0x555c2ac85c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc98800cfc0 tx=0x7fc98800f000 comp rx=0 tx=0).stop 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- 172.21.15.113:0/4180526091 shutdown_connections 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2acb55d0 0x555c2acb5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2ac89890 0x555c2ac8b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 --2- 172.21.15.113:0/4180526091 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2ac85840 0x555c2ac85c20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- 172.21.15.113:0/4180526091 >> 172.21.15.113:0/4180526091 conn(0x555c2ac878c0 msgr2=0x555c2ac89180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- 172.21.15.113:0/4180526091 shutdown_connections 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- 172.21.15.113:0/4180526091 wait complete. 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 -- start start 2024-02-26T12:20:15.748 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.755+0000 7fc999be7740 1 Processor -- start 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acb1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2aca7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2ac89d20 con 0x555c2aca7e40 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2ababe70 con 0x555c2aca8450 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c2ac8a000 con 0x555c2acb55d0 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc999be7740 10 client.0 _ll_register_callbacks cb 0x555c2abab840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc9952bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc9952bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59478/0 (socket says 172.21.15.113:59478) 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc9952bb640 1 -- 172.21.15.113:0/1386330708 learned_addr learned my addr 172.21.15.113:0/1386330708 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc994aba640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acb1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.756+0000 7fc98ffff640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2aca7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 -- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 msgr2=0x555c2acb1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.749 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acb1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 -- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 msgr2=0x555c2aca7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2aca7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 -- 172.21.15.113:0/1386330708 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c2abac240 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc994aba640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acb1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc9952bb640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc980058570 tx=0x7fc980058870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1384d2da9f2c1a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980086060 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc980054ee0 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc988011840 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc980075050 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 10 client.5232 fetch_fsmap learned FSMap version 14 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x555c2a9042d0 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011840 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc9800772e0 con 0x555c2aca7e40 2024-02-26T12:20:15.750 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 10 client.5232 fetch_fsmap finished waiting for FSMap version 14 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 20 client.5232 populate_metadata read hostname 'smithi113' 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acb6c50 0x555c2acb7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 4 client.5232 mds_command: new command op to 5019 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 --> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c2abfcbc0 con 0x555c2acb6c50 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.757+0000 7fc994aba640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acb6c50 0x555c2acb7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc96f7fe640 10 client.5232 ms_handle_connect on v2:172.21.15.113:6834/2648726034 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc994aba640 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acb6c50 0x555c2acb7030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73496c13e5c1615 server_cookie=bfaee4a7e792e25f in_seq=0 out_seq=0 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc96f7fe640 1 -- 172.21.15.113:0/1386330708 <== mds.0 v2:172.21.15.113:6834/2648726034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c2abfcbc0 con 0x555c2acb6c50 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc96f7fe640 10 client.5232 handle_command_reply: tid=0 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc999be7740 1 client.5232 shutdown 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 msgr2=0x555c2acb7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.758+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc980058570 tx=0x7fc980058870 comp rx=0 tx=0).stop 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 shutdown_connections 2024-02-26T12:20:15.751 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2acb7c30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2aca7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acb6c50 0x555c2acb7030 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 --2- 172.21.15.113:0/1386330708 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acb1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc96f7fe640 0 client.5232 ms_handle_reset on v2:172.21.15.113:6834/2648726034 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 >> 172.21.15.113:0/1386330708 conn(0x555c2ac85840 msgr2=0x555c2acb3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 shutdown_connections 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 1 -- 172.21.15.113:0/1386330708 wait complete. 2024-02-26T12:20:15.752 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.759+0000 7fc999be7740 20 client.5232 trim_cache size 0 max 16384 2024-02-26T12:20:15.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.774+0000 7fc999be7740 1 Processor -- start 2024-02-26T12:20:15.760 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.774+0000 7fc999be7740 1 -- start start 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2acb2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901f4b90 con 0x555c2aca7e40 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901f3f90 con 0x555c2aca8450 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901f4590 con 0x555c2acb55d0 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59494/0 (socket says 172.21.15.113:59494) 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 -- 172.21.15.113:0/3813926419 learned_addr learned my addr 172.21.15.113:0/3813926419 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc9952bb640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc98ffff640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2acb2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.763 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 -- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 msgr2=0x555c2acd1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 -- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 msgr2=0x555c2acb2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2acb2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 -- 172.21.15.113:0/3813926419 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c2acb8870 con 0x555c2aca7e40 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc9952bb640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc98ffff640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2acb2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc994aba640 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc98800ca10 tx=0x7fc988011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac1b6b2dc7dcc6f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.775+0000 7fc985ffb640 1 -- 172.21.15.113:0/3813926419 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988023040 con 0x555c2aca7e40 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc985ffb640 1 -- 172.21.15.113:0/3813926419 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011c70 con 0x555c2aca7e40 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc985ffb640 1 -- 172.21.15.113:0/3813926419 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98802e150 con 0x555c2aca7e40 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 -- 172.21.15.113:0/3813926419 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 msgr2=0x555c2aca8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc98800ca10 tx=0x7fc988011000 comp rx=0 tx=0).stop 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 -- 172.21.15.113:0/3813926419 shutdown_connections 2024-02-26T12:20:15.764 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca8450 0x555c2acb2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 --2- 172.21.15.113:0/3813926419 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca7e40 0x555c2aca8dd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 -- 172.21.15.113:0/3813926419 >> 172.21.15.113:0/3813926419 conn(0x555c2ac85840 msgr2=0x555c2ac80dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 -- 172.21.15.113:0/3813926419 shutdown_connections 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.776+0000 7fc999be7740 1 -- 172.21.15.113:0/3813926419 wait complete. 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.777+0000 7fc999be7740 1 -- start start 2024-02-26T12:20:15.765 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.777+0000 7fc999be7740 1 Processor -- start 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.777+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca7e40 0x555c2acd1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2acd2ae0 con 0x555c2aca8450 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2aca9870 con 0x555c2aca7e40 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c2acd3380 con 0x555c2acb55d0 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 10 client.0 _ll_register_callbacks cb 0x7fc980058640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59506/0 (socket says 172.21.15.113:59506) 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 -- 172.21.15.113:0/2936484273 learned_addr learned my addr 172.21.15.113:0/2936484273 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc994aba640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca7e40 0x555c2acd1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.769 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc9952bb640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 -- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 msgr2=0x555c2acd3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 -- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca7e40 msgr2=0x555c2acd1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca7e40 0x555c2acd1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 -- 172.21.15.113:0/2936484273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c2a9ce6b0 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc98ffff640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc978009960 tx=0x7fc97802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779a0be4e69f621f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc96f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.113:3300/0 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97804c060 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mon.0 v2:172.21.15.113:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc978031d30 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc988011c70 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc978038040 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 10 client.5238 fetch_fsmap learned FSMap version 14 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x555c2aca5410 con 0x555c2aca8450 2024-02-26T12:20:15.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.778+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mon.0 v2:172.21.15.113:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011c70 con 0x555c2aca8450 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mon.0 v2:172.21.15.113:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc978033440 con 0x555c2aca8450 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 10 client.5238 fetch_fsmap finished waiting for FSMap version 14 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 20 client.5238 populate_metadata read hostname 'smithi113' 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acd4720 0x555c2ac9abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 4 client.5238 mds_command: new command op to 5019 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 --> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555c2abf6f10 con 0x555c2acd4720 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc994aba640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acd4720 0x555c2ac9abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc96f7fe640 10 client.5238 ms_handle_connect on v2:172.21.15.113:6834/2648726034 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc994aba640 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acd4720 0x555c2ac9abd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450a1b91a108b9f9 server_cookie=44ada02eb32965fc in_seq=0 out_seq=0 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc96f7fe640 1 -- 172.21.15.113:0/2936484273 <== mds.0 v2:172.21.15.113:6834/2648726034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555c2abf6f10 con 0x555c2acd4720 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc96f7fe640 10 client.5238 handle_command_reply: tid=0 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 client.5238 shutdown 2024-02-26T12:20:15.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 msgr2=0x555c2acd1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc978009960 tx=0x7fc97802e000 comp rx=0 tx=0).stop 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 shutdown_connections 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:6834/2648726034,v1:172.21.15.113:6835/2648726034] conn(0x555c2acd4720 0x555c2ac9abd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555c2acb55d0 0x555c2acd3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x555c2aca8450 0x555c2acd1fd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 --2- 172.21.15.113:0/2936484273 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555c2aca7e40 0x555c2acd1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 >> 172.21.15.113:0/2936484273 conn(0x555c2ac85840 msgr2=0x555c2acaea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.779+0000 7fc96f7fe640 0 client.5238 ms_handle_reset on v2:172.21.15.113:6834/2648726034 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 shutdown_connections 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc999be7740 1 -- 172.21.15.113:0/2936484273 wait complete. 2024-02-26T12:20:15.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc999be7740 20 client.5238 trim_cache size 0 max 16384 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "cluster_fsid": "74a57275-9dde-4d5b-99d3-80ee62f4964a", 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "whoami": 0, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 5019, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "want_state": "up:active", 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "state": "up:active", 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs", 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "rank_uptime": 8.9568391680000001, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "mdsmap_epoch": 14, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch": 31, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "osdmap_epoch_barrier": 31, 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout: "uptime": 16.047812906000001 2024-02-26T12:20:15.773 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:15.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 msgr2=0x7fc97006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 0x7fc97006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc9900c9920 tx=0x7fc988007310 comp rx=0 tx=0).stop 2024-02-26T12:20:15.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 msgr2=0x7fc9900c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc98000b410 tx=0x7fc98000b810 comp rx=0 tx=0).stop 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 shutdown_connections 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fc97006b4d0 0x7fc97006d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc9900cdaf0 0x7fc9900c91d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9900ca570 0x7fc9900c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 --2- 172.21.15.113:0/2814018420 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc99006df90 0x7fc9900c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 >> 172.21.15.113:0/2814018420 conn(0x7fc9900cc9a0 msgr2=0x7fc9900b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 shutdown_connections 2024-02-26T12:20:15.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.780+0000 7fc996d1e640 1 -- 172.21.15.113:0/2814018420 wait complete. 2024-02-26T12:20:15.777 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-26T12:20:15.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 Processor -- start 2024-02-26T12:20:15.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 -- start start 2024-02-26T12:20:15.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e380b2d80 0x7f7e380d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380d1f50 con 0x7f7e3815def0 2024-02-26T12:20:15.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e380d2230 con 0x7f7e380d3530 2024-02-26T12:20:15.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3eb1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380d2510 con 0x7f7e380b2d80 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e37fff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e380b2d80 0x7f7e380d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.892+0000 7f7e3c8ba640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7e3815def0 0x7f7e380b9400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54764/0 (socket says 172.21.15.113:54764) 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e3c8ba640 1 -- 172.21.15.113:0/3769679067 learned_addr learned my addr 172.21.15.113:0/3769679067 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e37fff640 1 -- 172.21.15.113:0/3769679067 >> v1:172.21.15.152:6789/0 conn(0x7f7e380d3530 legacy=0x7f7e380ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e37fff640 1 -- 172.21.15.113:0/3769679067 >> v1:172.21.15.113:6789/0 conn(0x7f7e3815def0 legacy=0x7f7e380b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e37fff640 1 -- 172.21.15.113:0/3769679067 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e380d27f0 con 0x7f7e380b2d80 2024-02-26T12:20:15.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e377fe640 1 -- 172.21.15.113:0/3769679067 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579404082 0 0) 0x7f7e380d1f50 con 0x7f7e3815def0 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.893+0000 7f7e37fff640 1 --2- 172.21.15.113:0/3769679067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380b2d80 0x7f7e380d2ff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097d0 tx=0x7f7e2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa8827501784901 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e377fe640 1 -- 172.21.15.113:0/3769679067 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20035020 con 0x7f7e380b2d80 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e377fe640 1 -- 172.21.15.113:0/3769679067 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20031830 con 0x7f7e380b2d80 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e377fe640 1 -- 172.21.15.113:0/3769679067 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20031c00 con 0x7f7e380b2d80 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/3769679067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380b2d80 msgr2=0x7f7e380d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/3769679067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380b2d80 0x7f7e380d2ff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097d0 tx=0x7f7e2002b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/3769679067 shutdown_connections 2024-02-26T12:20:15.885 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/3769679067 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380b2d80 0x7f7e380d2ff0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/3769679067 >> 172.21.15.113:0/3769679067 conn(0x7f7e380728b0 msgr2=0x7f7e380d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/3769679067 shutdown_connections 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.894+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/3769679067 wait complete. 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.895+0000 7f7e3eb1e640 1 Processor -- start 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.895+0000 7f7e3eb1e640 1 -- start start 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e380b2d80 0x7f7e381528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.886 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3815ffc0 0x7f7e380ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380cf140 con 0x7f7e380d3530 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380cefc0 con 0x7f7e3815ffc0 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e3eb1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380b6c10 con 0x7f7e380b2d80 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:59530/0 (socket says 172.21.15.113:59530) 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.896+0000 7f7e37fff640 1 -- 172.21.15.113:0/1461896716 learned_addr learned my addr 172.21.15.113:0/1461896716 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 -- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e380b2d80 msgr2=0x7f7e381528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e380b2d80 0x7f7e381528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.887 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 -- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3815ffc0 msgr2=0x7f7e380ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3815ffc0 0x7f7e380ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 -- 172.21.15.113:0/1461896716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38153320 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e37fff640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e200098f0 tx=0x7f7e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2003ba80 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2003bc20 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e38152e30 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200453f0 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.897+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e381608d0 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.898+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38074a50 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.898+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e2004c060 con 0x7f7e380d3530 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.899+0000 7f7e357fa640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 0x7f7e1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:15.888 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.899+0000 7f7e3c8ba640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 0x7f7e1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:15.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.899+0000 7f7e3c8ba640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 0x7f7e1806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30007ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:15.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.899+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e200789b0 con 0x7f7e380d3530 2024-02-26T12:20:15.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:15.904+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7e20040070 con 0x7f7e380d3530 2024-02-26T12:20:16.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.110+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7e380cdbd0 con 0x7f7e380d3530 2024-02-26T12:20:16.097 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.111+0000 7f7e357fa640 1 -- 172.21.15.113:0/1461896716 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7e2002f2e0 con 0x7f7e380d3530 2024-02-26T12:20:16.097 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 msgr2=0x7f7e1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 0x7f7e1806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30007ce0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 msgr2=0x7f7e3815fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e200098f0 tx=0x7f7e200046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 shutdown_connections 2024-02-26T12:20:16.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7e1806b4d0 0x7f7e1806d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e3815ffc0 0x7f7e380ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e380d3530 0x7f7e3815fa80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 --2- 172.21.15.113:0/1461896716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e380b2d80 0x7f7e381528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 >> 172.21.15.113:0/1461896716 conn(0x7f7e380728b0 msgr2=0x7f7e380ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 shutdown_connections 2024-02-26T12:20:16.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:16.113+0000 7f7e3eb1e640 1 -- 172.21.15.113:0/1461896716 wait complete. 2024-02-26T12:20:16.109 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-26T12:20:16.110 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-26T12:20:16.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.110 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2024-02-26T12:20:16.126 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 1a:73:35:92:a6:cc brd ff:ff:ff:ff:ff:ff 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec34:f7ff:fe5e:37dd/64 scope link 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-26T12:20:16.127 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 7e:97:82:08:1b:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::7c97:82ff:fe08:1b8b/64 scope link 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 1a:73:35:92:a6:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::1873:35ff:fe92:a6cc/64 scope link 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2024-02-26T12:20:16.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.128 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-26T12:20:16.191 INFO:teuthology.orchestra.run.smithi113.stdout:1 2024-02-26T12:20:16.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.193 DEBUG:teuthology.orchestra.run.smithi113:> route 2024-02-26T12:20:16.249 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2024-02-26T12:20:16.249 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-26T12:20:16.249 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-26T12:20:16.249 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-26T12:20:16.249 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-26T12:20:16.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-26T12:20:16.250 DEBUG:teuthology.orchestra.run.smithi113:> ') 2024-02-26T12:20:16.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.346 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:20:16.360 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-26T12:20:16.361 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-26T12:20:16.361 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-26T12:20:16.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.361 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2024-02-26T12:20:16.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:20:16.428 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-26T12:20:16.483 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-26T12:20:16.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-26T12:20:16.483 DEBUG:teuthology.orchestra.run.smithi113:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-26T12:20:16.537 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-02-26T12:20:16.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.537 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:20:16.623 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:20:16.624 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:20:16.630 INFO:teuthology.orchestra.run.smithi113.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: resolved to: "172.21.15.113:3300,172.21.15.152:3300,172.21.15.152:3301" 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: trying mount with new device syntax: 0@74a57275-9dde-4d5b-99d3-80ee62f4964a.cephfs=/ 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.113:3300/172.21.15.152:3300/172.21.15.152:3301" will pass to kernel 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout: You just mounted a file system that supports labels which does not 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-26T12:20:16.631 INFO:teuthology.orchestra.run.smithi113.stdout: applications will generate AVC messages and not be allowed access to 2024-02-26T12:20:16.632 INFO:teuthology.orchestra.run.smithi113.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-26T12:20:16.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-26T12:20:16.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.633 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-26T12:20:16.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.660 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-26T12:20:16.721 INFO:teuthology.orchestra.run.smithi113.stdout:client5002 2024-02-26T12:20:16.721 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:20:16.721 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:16.776 DEBUG:teuthology.orchestra.run.smithi113:> mktemp -d --suffix=xfstests-dev 2024-02-26T12:20:16.831 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.PSkoJXyKuKxfstests-dev 2024-02-26T12:20:16.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.832 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.PSkoJXyKuKxfstests-dev) 2024-02-26T12:20:16.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:16.901 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.PSkoJXyKuKxfstests-dev) 2024-02-26T12:20:16.958 INFO:teuthology.orchestra.run.smithi113.stderr:Cloning into '/tmp/tmp.PSkoJXyKuKxfstests-dev'... 2024-02-26T12:20:17.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:17.628 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-02-26T12:20:17.687 DEBUG:teuthology.orchestra.run.smithi113:> mktemp -d --suffix=test 2024-02-26T12:20:17.741 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.g60tfhE71ftest 2024-02-26T12:20:17.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:17.742 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-02-26T12:20:17.798 DEBUG:teuthology.orchestra.run.smithi113:> mktemp -d --suffix=scratch 2024-02-26T12:20:17.852 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.p2aIjaGDG4scratch 2024-02-26T12:20:17.853 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-02-26T12:20:17.853 DEBUG:teuthology.orchestra.run.smithi113:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-02-26T12:20:18.506 INFO:teuthology.orchestra.run.smithi113.stdout:Last metadata expiration check: 0:03:36 ago on Mon 26 Feb 2024 12:16:42 PM UTC. 2024-02-26T12:20:18.630 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:18.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:18.818 INFO:teuthology.orchestra.run.smithi113.stderr:Modular dependency problems: 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 1: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 2: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 3: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 4: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 5: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 6: conflicting requests 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.819 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 7: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 8: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 9: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 10: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 11: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 12: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 13: conflicting requests 2024-02-26T12:20:18.820 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 14: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 15: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 16: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 17: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 18: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 19: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 20: conflicting requests 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.821 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 21: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 22: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 23: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 24: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 25: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 26: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 27: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 28: conflicting requests 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.822 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 29: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 30: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 31: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 32: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 33: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 34: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 35: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 36: conflicting requests 2024-02-26T12:20:18.823 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 37: cannot install the best candidate for the job 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 38: conflicting requests 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.824 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 39: cannot install the best candidate for the job 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 40: cannot install the best candidate for the job 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 41: cannot install the best candidate for the job 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 42: cannot install the best candidate for the job 2024-02-26T12:20:18.825 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 43: cannot install the best candidate for the job 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: Problem 44: cannot install the best candidate for the job 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.826 INFO:teuthology.orchestra.run.smithi113.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-26T12:20:18.827 INFO:teuthology.orchestra.run.smithi113.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-02-26T12:20:18.827 INFO:teuthology.orchestra.run.smithi113.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-02-26T12:20:18.827 INFO:teuthology.orchestra.run.smithi113.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-02-26T12:20:18.827 INFO:teuthology.orchestra.run.smithi113.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-02-26T12:20:18.827 INFO:teuthology.orchestra.run.smithi113.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-02-26T12:20:18.828 INFO:teuthology.orchestra.run.smithi113.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-02-26T12:20:18.830 INFO:teuthology.orchestra.run.smithi113.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-02-26T12:20:18.831 INFO:teuthology.orchestra.run.smithi113.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-02-26T12:20:18.833 INFO:teuthology.orchestra.run.smithi113.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-02-26T12:20:18.836 INFO:teuthology.orchestra.run.smithi113.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-02-26T12:20:18.837 INFO:teuthology.orchestra.run.smithi113.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-02-26T12:20:18.839 INFO:teuthology.orchestra.run.smithi113.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-02-26T12:20:18.840 INFO:teuthology.orchestra.run.smithi113.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2024-02-26T12:20:18.842 INFO:teuthology.orchestra.run.smithi113.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-02-26T12:20:18.843 INFO:teuthology.orchestra.run.smithi113.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-02-26T12:20:18.844 INFO:teuthology.orchestra.run.smithi113.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-02-26T12:20:18.845 INFO:teuthology.orchestra.run.smithi113.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-02-26T12:20:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-02-26T12:20:18.847 INFO:teuthology.orchestra.run.smithi113.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-02-26T12:20:18.850 INFO:teuthology.orchestra.run.smithi113.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-02-26T12:20:18.931 INFO:teuthology.orchestra.run.smithi113.stderr:Error: 2024-02-26T12:20:18.931 INFO:teuthology.orchestra.run.smithi113.stderr: Problem: package python3-libs-3.9.18-3.el9.x86_64 from baseos requires libreadline.so.8()(64bit), but none of the providers can be installed 2024-02-26T12:20:18.931 INFO:teuthology.orchestra.run.smithi113.stderr: - cannot install both readline-7.0-10.el8.x86_64 from CentOS-BaseOS and readline-8.1-4.el9.x86_64 from @System 2024-02-26T12:20:18.931 INFO:teuthology.orchestra.run.smithi113.stderr: - cannot install both readline-8.1-4.el9.x86_64 from baseos and readline-7.0-10.el8.x86_64 from CentOS-BaseOS 2024-02-26T12:20:18.932 INFO:teuthology.orchestra.run.smithi113.stderr: - package udftools-2.3-2.el8.x86_64 from CentOS-AppStream requires libreadline.so.7()(64bit), but none of the providers can be installed 2024-02-26T12:20:18.932 INFO:teuthology.orchestra.run.smithi113.stderr: - package python3-3.9.18-3.el9.x86_64 from baseos requires python3-libs(x86-64) = 3.9.18-3.el9, but none of the providers can be installed 2024-02-26T12:20:18.932 INFO:teuthology.orchestra.run.smithi113.stderr: - cannot install the best candidate for the job 2024-02-26T12:20:18.932 INFO:teuthology.orchestra.run.smithi113.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-02-26T12:20:18.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:18.971 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2024-02-26T12:20:18.971 INFO:tasks.cephfs_test_runner: 2024-02-26T12:20:18.971 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-26T12:20:18.972 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi113 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:Ran 1 test in 35.726s 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:====================================================================== 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-02-26T12:20:18.973 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: r.wait() 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi113 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-02-26T12:20:18.974 INFO:tasks.cephfs_test_runner: 2024-02-26T12:20:18.975 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-26T12:20:19.217 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3448385e366d49b8bd02bed60561c761 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_6085b91fefeb74bf4310344a87d81d3217ef7893/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-02-26T12:20:19.218 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-02-26T12:20:19.227 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-26T12:20:19.247 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-26T12:20:19.248 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:20:19.248 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:19.266 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:20:19.266 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:19.323 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:19.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 Processor -- start 2024-02-26T12:20:19.463 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 -- start start 2024-02-26T12:20:19.465 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f639806ab50 0x7f639806af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f63980b1720 0x7f63980cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63980b6670 con 0x7f63980b35b0 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63981618c0 con 0x7f639806ab50 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.478+0000 7f639d71e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63980cadb0 con 0x7f63980b1720 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f639806ab50 0x7f639806af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f639806ab50 0x7f639806af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43772/0 (socket says 172.21.15.113:43772) 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 -- 172.21.15.113:0/779122556 learned_addr learned my addr 172.21.15.113:0/779122556 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:19.466 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f63977fe640 1 --2- 172.21.15.113:0/779122556 >> v2:172.21.15.152:3300/0 conn(0x7f63980b1720 0x7f63980cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 -- 172.21.15.113:0/779122556 >> v2:172.21.15.152:3300/0 conn(0x7f63980b1720 msgr2=0x7f63980cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 --2- 172.21.15.113:0/779122556 >> v2:172.21.15.152:3300/0 conn(0x7f63980b1720 0x7f63980cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 -- 172.21.15.113:0/779122556 >> v1:172.21.15.152:6789/0 conn(0x7f63980b35b0 legacy=0x7f63980cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.479+0000 7f6396ffd640 1 -- 172.21.15.113:0/779122556 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639806b470 con 0x7f639806ab50 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f6396ffd640 1 --2- 172.21.15.113:0/779122556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f639806ab50 0x7f639806af30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6398072290 tx=0x7f638c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2ba651babacab9 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f6395ffb640 1 -- 172.21.15.113:0/779122556 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c035020 con 0x7f639806ab50 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f6395ffb640 1 -- 172.21.15.113:0/779122556 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c031870 con 0x7f639806ab50 2024-02-26T12:20:19.467 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f6395ffb640 1 -- 172.21.15.113:0/779122556 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c031c40 con 0x7f639806ab50 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 -- 172.21.15.113:0/779122556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f639806ab50 msgr2=0x7f639806af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 --2- 172.21.15.113:0/779122556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f639806ab50 0x7f639806af30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6398072290 tx=0x7f638c02b910 comp rx=0 tx=0).stop 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 -- 172.21.15.113:0/779122556 shutdown_connections 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 --2- 172.21.15.113:0/779122556 >> v2:172.21.15.152:3300/0 conn(0x7f63980b1720 0x7f63980cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 --2- 172.21.15.113:0/779122556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f639806ab50 0x7f639806af30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 -- 172.21.15.113:0/779122556 >> 172.21.15.113:0/779122556 conn(0x7f63980d0760 msgr2=0x7f63980d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:19.468 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 -- 172.21.15.113:0/779122556 shutdown_connections 2024-02-26T12:20:19.469 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.480+0000 7f639d71e640 1 -- 172.21.15.113:0/779122556 wait complete. 2024-02-26T12:20:19.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 Processor -- start 2024-02-26T12:20:19.471 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 -- start start 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f639806ab50 0x7f639815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63980b35b0 0x7f63980b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980b1f00 con 0x7f63980b1720 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980ce040 con 0x7f63980b35b0 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f639d71e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980cb000 con 0x7f639806ab50 2024-02-26T12:20:19.472 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f63967fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f63967fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43780/0 (socket says 172.21.15.113:43780) 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.482+0000 7f63967fc640 1 -- 172.21.15.113:0/2432945716 learned_addr learned my addr 172.21.15.113:0/2432945716 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 -- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f639806ab50 msgr2=0x7f639815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f639806ab50 0x7f639815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 -- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63980b35b0 msgr2=0x7f63980b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63980b35b0 0x7f63980b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 -- 172.21.15.113:0/2432945716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980c8f50 con 0x7f63980b1720 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f63967fc640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f638800c470 tx=0x7f6388001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.473 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880052d0 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388005470 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388007260 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980c9230 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.483+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63980c97f0 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.484+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6398074a50 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.485+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6388007400 con 0x7f63980b1720 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.485+0000 7f637f7fe640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 0x7f638406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.474 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.485+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6388089710 con 0x7f63980b1720 2024-02-26T12:20:19.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.485+0000 7f6396ffd640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 0x7f638406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.485+0000 7f6396ffd640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 0x7f638406d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f638c036000 tx=0x7f638c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.475 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.489+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6388058590 con 0x7f63980b1720 2024-02-26T12:20:19.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.661+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63980b0a50 con 0x7f63980b1720 2024-02-26T12:20:19.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.662+0000 7f637f7fe640 1 -- 172.21.15.113:0/2432945716 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7f6388057e90 con 0x7f63980b1720 2024-02-26T12:20:19.647 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:19.648 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":31,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:07.833837+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:20:04.388376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-26T12:20:05.144745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:19.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 msgr2=0x7f638406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 0x7f638406d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f638c036000 tx=0x7f638c030000 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 msgr2=0x7f63980b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f638800c470 tx=0x7f6388001e70 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 shutdown_connections 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f638406b500 0x7f638406d9c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f63980b35b0 0x7f63980b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f63980b1720 0x7f63980b4af0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 --2- 172.21.15.113:0/2432945716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f639806ab50 0x7f639815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.650 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 >> 172.21.15.113:0/2432945716 conn(0x7f63980d0760 msgr2=0x7f63980b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:19.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 shutdown_connections 2024-02-26T12:20:19.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.664+0000 7f639d71e640 1 -- 172.21.15.113:0/2432945716 wait complete. 2024-02-26T12:20:19.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-26T12:19:07.195487+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-26T12:20:04.388376+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-02-26T12:20:05.144745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-26T12:20:19.661 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-26T12:20:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.781+0000 7fbdb8768640 1 Processor -- start 2024-02-26T12:20:19.766 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.781+0000 7fbdb8768640 1 -- start start 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb8768640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbdb00cbac0 0x7fbdb006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb8768640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb015b430 con 0x7fbdb0154eb0 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb8768640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb015b710 con 0x7fbdb015af30 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb8768640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb015b9f0 con 0x7fbdb00cbac0 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb6504640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbdb0154eb0 0x7fbdb0071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44934/0 (socket says 172.21.15.113:44934) 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb6504640 1 -- 172.21.15.113:0/1167435706 learned_addr learned my addr 172.21.15.113:0/1167435706 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:19.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512634373 0 0) 0x7fbdb015b430 con 0x7fbdb0154eb0 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd9c003520 con 0x7fbdb0154eb0 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.782+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/1167435706 >> v2:172.21.15.152:3300/0 conn(0x7fbdb00cbac0 0x7fbdb006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448668708 0 0) 0x7fbd9c003520 con 0x7fbdb0154eb0 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 >> v2:172.21.15.152:3300/0 conn(0x7fbdb00cbac0 msgr2=0x7fbdb006f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 --2- 172.21.15.113:0/1167435706 >> v2:172.21.15.152:3300/0 conn(0x7fbdb00cbac0 0x7fbdb006f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 >> v1:172.21.15.152:6789/0 conn(0x7fbdb015af30 legacy=0x7fbdb00cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb015bcd0 con 0x7fbdb0154eb0 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fbdac0019f0 con 0x7fbdb0154eb0 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/1167435706 >> v2:172.21.15.152:3300/0 conn(0x7fbdb00cbac0 0x7fbdb006f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 >> v1:172.21.15.113:6789/0 conn(0x7fbdb0154eb0 legacy=0x7fbdb0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb015b9f0 con 0x7fbd9c0039b0 2024-02-26T12:20:19.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00c110 con 0x7fbd9c004800 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c00c310 con 0x7fbd9c0051c0 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5d03640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 -- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd9c0051c0 msgr2=0x7fbd9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd9c0051c0 0x7fbd9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 -- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c004800 msgr2=0x7fbd9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:19.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6504640 1 -- 172.21.15.113:0/1167435706 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c003520 con 0x7fbd9c0039b0 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb6d05640 1 -- 172.21.15.113:0/1167435706 reap_dead start 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.783+0000 7fbdb5d03640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c004800 0x7fbd9c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb6504640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003dd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00a840 tx=0x7fbd9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5616ce090e078881 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac00a460 con 0x7fbd9c0039b0 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac034650 con 0x7fbd9c0039b0 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb5502640 1 -- 172.21.15.113:0/1167435706 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac034a80 con 0x7fbd9c0039b0 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb8768640 1 -- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 msgr2=0x7fbd9c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.774 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.784+0000 7fbdb8768640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003dd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00a840 tx=0x7fbd9c005830 comp rx=0 tx=0).stop 2024-02-26T12:20:19.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.785+0000 7fbdb8768640 1 -- 172.21.15.113:0/1167435706 shutdown_connections 2024-02-26T12:20:19.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.785+0000 7fbdb8768640 1 --2- 172.21.15.113:0/1167435706 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbd9c0039b0 0x7fbd9c003dd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.785+0000 7fbdb8768640 1 -- 172.21.15.113:0/1167435706 >> 172.21.15.113:0/1167435706 conn(0x7fbdb00cc100 msgr2=0x7fbdb00cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:19.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.785+0000 7fbdb8768640 1 -- 172.21.15.113:0/1167435706 shutdown_connections 2024-02-26T12:20:19.775 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.785+0000 7fbdb8768640 1 -- 172.21.15.113:0/1167435706 wait complete. 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 Processor -- start 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 -- start start 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c0039b0 0x7fbdb00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 0x7fbdb00b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0155410 con 0x7fbdb01f5860 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb0155290 con 0x7fbd9c0039b0 2024-02-26T12:20:19.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb8768640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb006f2b0 con 0x7fbdb00b2440 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.786+0000 7fbdb6d05640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43792/0 (socket says 172.21.15.113:43792) 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 -- 172.21.15.113:0/2615770086 learned_addr learned my addr 172.21.15.113:0/2615770086 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6504640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c0039b0 0x7fbdb00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb5d03640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 0x7fbdb00b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 -- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 msgr2=0x7fbdb00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 0x7fbdb00b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 -- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c0039b0 msgr2=0x7fbdb00b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c0039b0 0x7fbdb00b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 -- 172.21.15.113:0/2615770086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb013ca80 con 0x7fbdb01f5860 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb5d03640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 0x7fbdb00b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb6d05640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbdb006f850 tx=0x7fbda8010920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800f040 con 0x7fbdb01f5860 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda801a070 con 0x7fbdb01f5860 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb00b0690 con 0x7fbdb01f5860 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8003610 con 0x7fbdb01f5860 2024-02-26T12:20:19.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.787+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb01468d0 con 0x7fbdb01f5860 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.788+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb0074a50 con 0x7fbdb01f5860 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.789+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbda80037b0 con 0x7fbdb01f5860 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.789+0000 7fbda6ffd640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.789+0000 7fbdb6504640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.789+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda8089e60 con 0x7fbdb01f5860 2024-02-26T12:20:19.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.789+0000 7fbdb6504640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 0x7fbd9406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdac034000 tx=0x7fbdac036040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:19.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.793+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbda8058ce0 con 0x7fbdb01f5860 2024-02-26T12:20:19.949 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.964+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdb0072490 con 0x7fbdb01f5860 2024-02-26T12:20:19.950 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.964+0000 7fbda6ffd640 1 -- 172.21.15.113:0/2615770086 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbda80585e0 con 0x7fbdb01f5860 2024-02-26T12:20:19.950 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 1 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 msgr2=0x7fbd9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 0x7fbd9406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdac034000 tx=0x7fbdac036040 comp rx=0 tx=0).stop 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 msgr2=0x7fbdb01f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbdb006f850 tx=0x7fbda8010920 comp rx=0 tx=0).stop 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 shutdown_connections 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbd9406b4d0 0x7fbd9406d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.952 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbdb01f5860 0x7fbdb01f5d10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbdb00b2440 0x7fbdb00b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 --2- 172.21.15.113:0/2615770086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd9c0039b0 0x7fbdb00b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:19.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 >> 172.21.15.113:0/2615770086 conn(0x7fbdb00cc100 msgr2=0x7fbdb014c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:19.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 shutdown_connections 2024-02-26T12:20:19.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:19.966+0000 7fbdb8768640 1 -- 172.21.15.113:0/2615770086 wait complete. 2024-02-26T12:20:19.962 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-26T12:20:20.066 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.081+0000 7f4a7020f640 1 Processor -- start 2024-02-26T12:20:20.067 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.081+0000 7f4a7020f640 1 -- start start 2024-02-26T12:20:20.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a7020f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a6806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a7020f640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6815b430 con 0x7f4a6815af30 2024-02-26T12:20:20.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a7020f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6815b710 con 0x7f4a68154eb0 2024-02-26T12:20:20.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a7020f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6815b9f0 con 0x7f4a680cbac0 2024-02-26T12:20:20.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6d7aa640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f4a6815af30 0x7f4a680cb3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44936/0 (socket says 172.21.15.113:44936) 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6d7aa640 1 -- 172.21.15.113:0/1080147156 learned_addr learned my addr 172.21.15.113:0/1080147156 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a6806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812430721 0 0) 0x7f4a6815b430 con 0x7f4a6815af30 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a54003520 con 0x7f4a6815af30 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1613705990 0 0) 0x7f4a54003520 con 0x7f4a6815af30 2024-02-26T12:20:20.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.082+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 msgr2=0x7f4a6806f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a6806f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 >> v1:172.21.15.152:6789/0 conn(0x7f4a68154eb0 legacy=0x7f4a68071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6815bcd0 con 0x7f4a6815af30 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f4a58001670 con 0x7f4a6815af30 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 >> v1:172.21.15.113:6789/0 conn(0x7f4a6815af30 legacy=0x7f4a680cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a540039e0 0x7f4a54003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6815b9f0 con 0x7f4a54004d40 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5400baa0 con 0x7f4a540039e0 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5400bca0 con 0x7f4a680cbac0 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6dfab640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a540039e0 0x7f4a54003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6d7aa640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 -- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 msgr2=0x7f4a54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a680cbac0 0x7f4a54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 -- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a540039e0 msgr2=0x7f4a54003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a540039e0 0x7f4a54003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.083+0000 7f4a6e7ac640 1 -- 172.21.15.113:0/1080147156 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54003520 con 0x7f4a54004d40 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a540051c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009fc0 tx=0x7f4a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3476d4a6792b64be server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60039070 con 0x7f4a54004d40 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6002cc20 con 0x7f4a54004d40 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a6cfa9640 1 -- 172.21.15.113:0/1080147156 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a60009c10 con 0x7f4a54004d40 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a7020f640 1 -- 172.21.15.113:0/1080147156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 msgr2=0x7f4a540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a7020f640 1 --2- 172.21.15.113:0/1080147156 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a540051c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009fc0 tx=0x7f4a54005830 comp rx=0 tx=0).stop 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a6e7ac640 1 -- 172.21.15.113:0/1080147156 reap_dead start 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a7020f640 1 -- 172.21.15.113:0/1080147156 shutdown_connections 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.084+0000 7f4a7020f640 1 -- 172.21.15.113:0/1080147156 >> 172.21.15.113:0/1080147156 conn(0x7f4a680cc100 msgr2=0x7f4a680cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.085+0000 7f4a7020f640 1 -- 172.21.15.113:0/1080147156 shutdown_connections 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.085+0000 7f4a7020f640 1 -- 172.21.15.113:0/1080147156 wait complete. 2024-02-26T12:20:20.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 Processor -- start 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 -- start start 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a681f43c0 0x7f4a681f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 0x7f4a6814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68155410 con 0x7f4a54004d40 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a68155290 con 0x7f4a681f43c0 2024-02-26T12:20:20.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a7020f640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6806f2b0 con 0x7f4a681f52f0 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a6dfab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a6dfab640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43798/0 (socket says 172.21.15.113:43798) 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.086+0000 7f4a6dfab640 1 -- 172.21.15.113:0/2420044378 learned_addr learned my addr 172.21.15.113:0/2420044378 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6d7aa640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a681f43c0 0x7f4a681f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 0x7f4a6814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 -- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 msgr2=0x7f4a6814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 0x7f4a6814c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 -- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a681f43c0 msgr2=0x7f4a681f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a681f43c0 0x7f4a681f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 -- 172.21.15.113:0/2420044378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680b3970 con 0x7f4a54004d40 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6e7ac640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 0x7f4a6814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:20.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a6dfab640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400f7c0 tx=0x7f4a6400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640052e0 con 0x7f4a54004d40 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64018070 con 0x7f4a54004d40 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a681f4880 con 0x7f4a54004d40 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400d910 con 0x7f4a54004d40 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.087+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a680b3ef0 con 0x7f4a54004d40 2024-02-26T12:20:20.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.088+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a68074a50 con 0x7f4a54004d40 2024-02-26T12:20:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.088+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4a6400dab0 con 0x7f4a54004d40 2024-02-26T12:20:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.089+0000 7f4a5e7fc640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 0x7f4a4c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.089+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a6408a0e0 con 0x7f4a54004d40 2024-02-26T12:20:20.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.089+0000 7f4a6d7aa640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 0x7f4a4c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.089+0000 7f4a6d7aa640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 0x7f4a4c06d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a580010e0 tx=0x7f4a580078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.093+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a64058ed0 con 0x7f4a54004d40 2024-02-26T12:20:20.248 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.263+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a68072490 con 0x7f4a54004d40 2024-02-26T12:20:20.249 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.263+0000 7f4a5e7fc640 1 -- 172.21.15.113:0/2420044378 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a640587d0 con 0x7f4a54004d40 2024-02-26T12:20:20.249 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 32 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 msgr2=0x7f4a4c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 0x7f4a4c06d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a580010e0 tx=0x7f4a580078f0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 msgr2=0x7f4a68142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400f7c0 tx=0x7f4a6400fc80 comp rx=0 tx=0).stop 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 shutdown_connections 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f4a4c06b500 0x7f4a4c06d9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a681f52f0 0x7f4a6814c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a681f43c0 0x7f4a681f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.251 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 --2- 172.21.15.113:0/2420044378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a54004d40 0x7f4a68142720 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 >> 172.21.15.113:0/2420044378 conn(0x7f4a680cc100 msgr2=0x7f4a6806e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 shutdown_connections 2024-02-26T12:20:20.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.265+0000 7f4a7020f640 1 -- 172.21.15.113:0/2420044378 wait complete. 2024-02-26T12:20:20.261 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-26T12:20:20.365 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.380+0000 7fbf56175640 1 Processor -- start 2024-02-26T12:20:20.365 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.380+0000 7fbf56175640 1 -- start start 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf56175640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500cbac0 0x7fbf5006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf56175640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5015b430 con 0x7fbf5015af30 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf56175640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5015b710 con 0x7fbf50154eb0 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf56175640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500ce360 con 0x7fbf500cbac0 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4effd640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fbf5015af30 0x7fbf500cb3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44944/0 (socket says 172.21.15.113:44944) 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4effd640 1 -- 172.21.15.113:0/2567779724 learned_addr learned my addr 172.21.15.113:0/2567779724 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:20.369 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4ffff640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500cbac0 0x7fbf5006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735571285 0 0) 0x7fbf5015b430 con 0x7fbf5015af30 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf38003520 con 0x7fbf5015af30 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469679607 0 0) 0x7fbf5015b710 con 0x7fbf50154eb0 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf5015b430 con 0x7fbf50154eb0 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1966988819 0 0) 0x7fbf38003520 con 0x7fbf5015af30 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500cbac0 msgr2=0x7fbf5006f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500cbac0 0x7fbf5006f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.370 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 >> v1:172.21.15.152:6789/0 conn(0x7fbf50154eb0 legacy=0x7fbf50071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5015b9f0 con 0x7fbf5015af30 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fbf44001670 con 0x7fbf5015af30 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 >> v1:172.21.15.113:6789/0 conn(0x7fbf5015af30 legacy=0x7fbf500cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf38003b70 0x7fbf38003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf380051c0 0x7fbf3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500ce360 con 0x7fbf38004800 2024-02-26T12:20:20.371 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800c060 con 0x7fbf38003b70 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3800c260 con 0x7fbf380051c0 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.381+0000 7fbf4ffff640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500cbac0 0x7fbf5006f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4f7fe640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf38003b70 0x7fbf38003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4ffff640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf380051c0 0x7fbf3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 -- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf380051c0 msgr2=0x7fbf3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf380051c0 0x7fbf3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.372 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 -- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf38003b70 msgr2=0x7fbf38003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf38003b70 0x7fbf38003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 -- 172.21.15.113:0/2567779724 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38003520 con 0x7fbf38004800 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.382+0000 7fbf4effd640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf38004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbf5015b360 tx=0x7fbf38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55153b127560b45 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44007ca0 con 0x7fbf38004800 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44030070 con 0x7fbf38004800 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf4e7fc640 1 -- 172.21.15.113:0/2567779724 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44005d30 con 0x7fbf38004800 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 -- 172.21.15.113:0/2567779724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 msgr2=0x7fbf38004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.373 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 --2- 172.21.15.113:0/2567779724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf38004c80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbf5015b360 tx=0x7fbf38005830 comp rx=0 tx=0).stop 2024-02-26T12:20:20.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf4ffff640 1 -- 172.21.15.113:0/2567779724 reap_dead start 2024-02-26T12:20:20.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 -- 172.21.15.113:0/2567779724 shutdown_connections 2024-02-26T12:20:20.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 -- 172.21.15.113:0/2567779724 >> 172.21.15.113:0/2567779724 conn(0x7fbf500cc100 msgr2=0x7fbf500cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 -- 172.21.15.113:0/2567779724 shutdown_connections 2024-02-26T12:20:20.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.383+0000 7fbf56175640 1 -- 172.21.15.113:0/2567779724 wait complete. 2024-02-26T12:20:20.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.384+0000 7fbf56175640 1 Processor -- start 2024-02-26T12:20:20.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 -- start start 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500af5d0 0x7fbf500afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf5014fd80 0x7fbf50150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500ccf60 con 0x7fbf38004800 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500ccde0 con 0x7fbf5014fd80 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf56175640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50155290 con 0x7fbf500af5d0 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf4f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf4f7fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43808/0 (socket says 172.21.15.113:43808) 2024-02-26T12:20:20.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf4f7fe640 1 -- 172.21.15.113:0/215648135 learned_addr learned my addr 172.21.15.113:0/215648135 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf4ffff640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf5014fd80 0x7fbf50150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.385+0000 7fbf4effd640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500af5d0 0x7fbf500afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 -- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500af5d0 msgr2=0x7fbf500afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500af5d0 0x7fbf500afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 -- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf5014fd80 msgr2=0x7fbf50150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf5014fd80 0x7fbf50150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 -- 172.21.15.113:0/215648135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf501f4e80 con 0x7fbf38004800 2024-02-26T12:20:20.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf4f7fe640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000f880 tx=0x7fbf4000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000fe70 con 0x7fbf38004800 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf40018070 con 0x7fbf38004800 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf501f5160 con 0x7fbf38004800 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000d730 con 0x7fbf38004800 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.386+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf501f5720 con 0x7fbf38004800 2024-02-26T12:20:20.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.387+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf500aff90 con 0x7fbf38004800 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.387+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf4000d8d0 con 0x7fbf38004800 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.388+0000 7fbf37fff640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.388+0000 7fbf4effd640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.388+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf40089ff0 con 0x7fbf38004800 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.388+0000 7fbf4effd640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf44034000 tx=0x7fbf44007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.381 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.392+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf40058820 con 0x7fbf38004800 2024-02-26T12:20:20.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.561+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf50074a50 con 0x7fbf38004800 2024-02-26T12:20:20.547 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.562+0000 7fbf37fff640 1 -- 172.21.15.113:0/215648135 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf4005c8c0 con 0x7fbf38004800 2024-02-26T12:20:20.547 INFO:teuthology.orchestra.run.smithi113.stdout:pg_num: 64 2024-02-26T12:20:20.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 msgr2=0x7fbf3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf44034000 tx=0x7fbf44007000 comp rx=0 tx=0).stop 2024-02-26T12:20:20.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 msgr2=0x7fbf50142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.549 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000f880 tx=0x7fbf4000fd40 comp rx=0 tx=0).stop 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 shutdown_connections 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbf3c06b4d0 0x7fbf3c06d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbf5014fd80 0x7fbf50150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbf500af5d0 0x7fbf500afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 --2- 172.21.15.113:0/215648135 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf38004800 0x7fbf50142fb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 >> 172.21.15.113:0/215648135 conn(0x7fbf500cc100 msgr2=0x7fbf50153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 shutdown_connections 2024-02-26T12:20:20.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.564+0000 7fbf56175640 1 -- 172.21.15.113:0/215648135 wait complete. 2024-02-26T12:20:20.560 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-26T12:20:20.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.676+0000 7f350e42d640 1 Processor -- start 2024-02-26T12:20:20.662 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 -- start start 2024-02-26T12:20:20.664 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 0x7f35080d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f35080b7270 0x7f35080b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080b6db0 con 0x7f35080d04e0 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080d2bf0 con 0x7f35080b7270 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350e42d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080d0e00 con 0x7f35080d2780 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350c9ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f35080b7270 0x7f35080b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350c9ca640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f35080b7270 0x7f35080b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43820/0 (socket says 172.21.15.113:43820) 2024-02-26T12:20:20.665 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.677+0000 7f350c9ca640 1 -- 172.21.15.113:0/1868017723 learned_addr learned my addr 172.21.15.113:0/1868017723 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f35077fe640 1 --2- 172.21.15.113:0/1868017723 >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 0x7f35080d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f350c9ca640 1 -- 172.21.15.113:0/1868017723 >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 msgr2=0x7f35080d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f350c9ca640 1 --2- 172.21.15.113:0/1868017723 >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 0x7f35080d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f350c9ca640 1 -- 172.21.15.113:0/1868017723 >> v1:172.21.15.152:6789/0 conn(0x7f35080d04e0 legacy=0x7f35080cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f350c9ca640 1 -- 172.21.15.113:0/1868017723 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080d2e10 con 0x7f35080b7270 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f35077fe640 1 --2- 172.21.15.113:0/1868017723 >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 0x7f35080d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.678+0000 7f350c9ca640 1 --2- 172.21.15.113:0/1868017723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35080b76a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f35080b6ba0 tx=0x7f350002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2168fcef61c80fa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f3506ffd640 1 -- 172.21.15.113:0/1868017723 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350002ca80 con 0x7f35080b7270 2024-02-26T12:20:20.666 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f3506ffd640 1 -- 172.21.15.113:0/1868017723 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350002cc20 con 0x7f35080b7270 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f3506ffd640 1 -- 172.21.15.113:0/1868017723 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000343f0 con 0x7f35080b7270 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 -- 172.21.15.113:0/1868017723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 msgr2=0x7f35080b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 --2- 172.21.15.113:0/1868017723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35080b76a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f35080b6ba0 tx=0x7f350002bee0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 -- 172.21.15.113:0/1868017723 shutdown_connections 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 --2- 172.21.15.113:0/1868017723 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35080b76a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 --2- 172.21.15.113:0/1868017723 >> v2:172.21.15.152:3300/0 conn(0x7f35080d2780 0x7f35080d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.667 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 -- 172.21.15.113:0/1868017723 >> 172.21.15.113:0/1868017723 conn(0x7f35080728b0 msgr2=0x7f35080b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 -- 172.21.15.113:0/1868017723 shutdown_connections 2024-02-26T12:20:20.668 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.679+0000 7f350e42d640 1 -- 172.21.15.113:0/1868017723 wait complete. 2024-02-26T12:20:20.670 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.680+0000 7f350e42d640 1 Processor -- start 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 -- start start 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35080d04e0 0x7f3508157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35080d2780 0x7f35081491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080d36b0 con 0x7f35080b7270 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080d33d0 con 0x7f35080d04e0 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350e42d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350815e050 con 0x7f35080d2780 2024-02-26T12:20:20.671 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f3507fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f3507fff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43824/0 (socket says 172.21.15.113:43824) 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f3507fff640 1 -- 172.21.15.113:0/1975288528 learned_addr learned my addr 172.21.15.113:0/1975288528 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f35077fe640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35080d04e0 0x7f3508157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.681+0000 7f350c9ca640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35080d2780 0x7f35081491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 -- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35080d2780 msgr2=0x7f35081491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35080d2780 0x7f35081491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.672 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 -- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35080d04e0 msgr2=0x7f3508157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35080d04e0 0x7f3508157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 -- 172.21.15.113:0/1975288528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080cc930 con 0x7f35080b7270 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3507fff640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c3c0 tx=0x7f34f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80052d0 con 0x7f35080b7270 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8005490 con 0x7f35080b7270 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3508149d20 con 0x7f35080b7270 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8007260 con 0x7f35080b7270 2024-02-26T12:20:20.673 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.682+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35080ccbf0 con 0x7f35080b7270 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.683+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3508074a50 con 0x7f35080b7270 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.683+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f34f8007400 con 0x7f35080b7270 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.684+0000 7f3504ff9640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 0x7f34f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.684+0000 7f35077fe640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 0x7f34f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.684+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34f80895f0 con 0x7f35080b7270 2024-02-26T12:20:20.674 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.684+0000 7f35077fe640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 0x7f34f406d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3508161180 tx=0x7f34fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:20.675 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.688+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35080b6db0 con 0x7f35080b7270 2024-02-26T12:20:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.871+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3508160ed0 con 0x7f35080b7270 2024-02-26T12:20:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.872+0000 7f3504ff9640 1 -- 172.21.15.113:0/1975288528 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34f8057e20 con 0x7f35080b7270 2024-02-26T12:20:20.857 INFO:teuthology.orchestra.run.smithi113.stderr:listed 0 entries 2024-02-26T12:20:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 msgr2=0x7f34f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.859 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 0x7f34f406d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3508161180 tx=0x7f34fc008040 comp rx=0 tx=0).stop 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 msgr2=0x7f35081f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c3c0 tx=0x7f34f800c880 comp rx=0 tx=0).stop 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 shutdown_connections 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f34f406b4d0 0x7f34f406d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35080d2780 0x7f35081491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35080d04e0 0x7f3508157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.860 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 --2- 172.21.15.113:0/1975288528 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f35080b7270 0x7f35081f38d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 >> 172.21.15.113:0/1975288528 conn(0x7f35080728b0 msgr2=0x7f35080d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 shutdown_connections 2024-02-26T12:20:20.861 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:20.874+0000 7f350e42d640 1 -- 172.21.15.113:0/1975288528 wait complete. 2024-02-26T12:20:20.870 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-26T12:20:20.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:20.870 DEBUG:teuthology.orchestra.run.smithi113:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-26T12:20:20.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:20.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:20.901 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-26T12:20:20.956 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2024-02-26T12:20:20.956 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:21.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056363,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-02-26T12:20:21.014 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:20:21.014 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:21.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=515 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-26T12:20:21.032 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-02-26T12:20:21.032 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-26T12:20:21.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=515 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-02-26T12:20:21.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.087 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:20:21.102 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-02-26T12:20:21.103 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-26T12:20:21.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.103 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-02-26T12:20:21.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.171 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-26T12:20:21.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.239 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-02-26T12:20:21.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.339 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2024-02-26T12:20:21.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.353 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2024-02-26T12:20:21.423 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2024-02-26T12:20:21.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:21.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.425 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:20:21.440 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-02-26T12:20:21.440 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-26T12:20:21.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-02-26T12:20:21.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-26T12:20:21.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-02-26T12:20:21.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.665 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-02-26T12:20:21.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-26T12:20:21.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-02-26T12:20:21.750 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-02-26T12:20:21.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:21.752 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-26T12:20:21.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-26T12:20:21.762 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:21.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.881+0000 7f219071e640 1 Processor -- start 2024-02-26T12:20:21.866 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.881+0000 7f219071e640 1 -- start start 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f219071e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f218815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f219071e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f218806d250 0x7f21880b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f219071e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218815eb60 con 0x7f21880b3250 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f219071e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880af130 con 0x7f218806d250 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f219071e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218815ee40 con 0x7f21880aed50 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218ecbb640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f21880b3250 0x7f218815bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44956/0 (socket says 172.21.15.113:44956) 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218ecbb640 1 -- 172.21.15.113:0/2725997517 learned_addr learned my addr 172.21.15.113:0/2725997517 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:21.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218dcb9640 1 --2- 172.21.15.113:0/2725997517 >> v2:172.21.15.152:3300/0 conn(0x7f218806d250 0x7f21880b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218e4ba640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f218815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707349772 0 0) 0x7f218815eb60 con 0x7f21880b3250 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003520 con 0x7f21880b3250 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 112162166 0 0) 0x7f2174003520 con 0x7f21880b3250 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 msgr2=0x7f218815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f218815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 >> v2:172.21.15.152:3300/0 conn(0x7f218806d250 msgr2=0x7f21880b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:21.871 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 --2- 172.21.15.113:0/2725997517 >> v2:172.21.15.152:3300/0 conn(0x7f218806d250 0x7f21880b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218815f120 con 0x7f21880b3250 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f21800019f0 con 0x7f21880b3250 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 >> v1:172.21.15.113:6789/0 conn(0x7f21880b3250 legacy=0x7f218815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.872 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f21740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815ee40 con 0x7f21740039b0 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217400b9c0 con 0x7f2174004800 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217400bb40 con 0x7f21880aed50 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218e4ba640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.882+0000 7f218dcb9640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218ecbb640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f21740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 -- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 msgr2=0x7f21740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:21.873 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880aed50 0x7f21740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 -- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2174004800 msgr2=0x7f2174004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2174004800 0x7f2174004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 -- 172.21.15.113:0/2725997517 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174003520 con 0x7f21740039b0 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218e4ba640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2184009ac0 tx=0x7f2174005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f88a9116c062bbd server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.883+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184039070 con 0x7f21740039b0 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218402c6b0 con 0x7f21740039b0 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f218d4b8640 1 -- 172.21.15.113:0/2725997517 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184009690 con 0x7f21740039b0 2024-02-26T12:20:21.874 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 -- 172.21.15.113:0/2725997517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 msgr2=0x7f2174003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 --2- 172.21.15.113:0/2725997517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2174003dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2184009ac0 tx=0x7f2174005830 comp rx=0 tx=0).stop 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f218ecbb640 1 -- 172.21.15.113:0/2725997517 reap_dead start 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 -- 172.21.15.113:0/2725997517 shutdown_connections 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 -- 172.21.15.113:0/2725997517 >> 172.21.15.113:0/2725997517 conn(0x7f218806ab50 msgr2=0x7f218806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 -- 172.21.15.113:0/2725997517 shutdown_connections 2024-02-26T12:20:21.875 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.884+0000 7f219071e640 1 -- 172.21.15.113:0/2725997517 wait complete. 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.885+0000 7f219071e640 1 Processor -- start 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.885+0000 7f219071e640 1 -- start start 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21880b0cb0 0x7f21881528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880ce3f0 0x7f218814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815c810 con 0x7f21740039b0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815c690 con 0x7f21880b0cb0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f219071e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218815e460 con 0x7f21880ce3f0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43846/0 (socket says 172.21.15.113:43846) 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 -- 172.21.15.113:0/3343999386 learned_addr learned my addr 172.21.15.113:0/3343999386 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218dcb9640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21880b0cb0 0x7f21881528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218ecbb640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880ce3f0 0x7f218814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 -- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880ce3f0 msgr2=0x7f218814ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:21.879 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880ce3f0 0x7f218814ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 -- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21880b0cb0 msgr2=0x7f21881528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21880b0cb0 0x7f21881528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.886+0000 7f218e4ba640 1 -- 172.21.15.113:0/3343999386 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880b1130 con 0x7f21740039b0 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f218e4ba640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2184037040 tx=0x7f2184004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184042020 con 0x7f21740039b0 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218403a040 con 0x7f21740039b0 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2188151b20 con 0x7f21740039b0 2024-02-26T12:20:21.880 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184039070 con 0x7f21740039b0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.887+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21881520e0 con 0x7f21740039b0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.888+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188074a50 con 0x7f21740039b0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.888+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2184045020 con 0x7f21740039b0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.889+0000 7f217effd640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 0x7f216c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.889+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21840ab690 con 0x7f21740039b0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.889+0000 7f218dcb9640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 0x7f216c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.889+0000 7f218dcb9640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 0x7f216c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2188155550 tx=0x7f2178008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:21.881 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:21.893+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f218404c070 con 0x7f21740039b0 2024-02-26T12:20:22.047 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.061+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2188152e20 con 0x7f216c06b500 2024-02-26T12:20:22.052 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.067+0000 7f217effd640 1 -- 172.21.15.113:0/3343999386 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7f21780149d0 con 0x7f216c06b500 2024-02-26T12:20:22.056 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:22.058 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:22.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 msgr2=0x7f216c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.060 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 0x7f216c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2188155550 tx=0x7f2178008040 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 msgr2=0x7f2188155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2184037040 tx=0x7f2184004730 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 shutdown_connections 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f216c06b500 0x7f216c06d9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21880ce3f0 0x7f218814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21880b0cb0 0x7f21881528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 --2- 172.21.15.113:0/3343999386 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21740039b0 0x7f2188155f70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 >> 172.21.15.113:0/3343999386 conn(0x7f218806ab50 msgr2=0x7f21880cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.061 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 shutdown_connections 2024-02-26T12:20:22.062 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.070+0000 7f219071e640 1 -- 172.21.15.113:0/3343999386 wait complete. 2024-02-26T12:20:22.066 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-02-26T12:20:21.168508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220108,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754612,"statfs":{"total":773094113280,"available":772868722688,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003537"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352976+0000","last_change":"2024-02-26T12:20:06.844968+0000","last_active":"2024-02-26T12:20:08.352976+0000","last_peered":"2024-02-26T12:20:08.352976+0000","last_clean":"2024-02-26T12:20:08.352976+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:08.352976+0000","last_undegraded":"2024-02-26T12:20:08.352976+0000","last_fullsized":"2024-02-26T12:20:08.352976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:50.636359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353304+0000","last_change":"2024-02-26T12:20:06.849184+0000","last_active":"2024-02-26T12:20:08.353304+0000","last_peered":"2024-02-26T12:20:08.353304+0000","last_clean":"2024-02-26T12:20:08.353304+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:08.353304+0000","last_undegraded":"2024-02-26T12:20:08.353304+0000","last_fullsized":"2024-02-26T12:20:08.353304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841079+0000","last_change":"2024-02-26T12:20:06.834964+0000","last_active":"2024-02-26T12:20:07.841079+0000","last_peered":"2024-02-26T12:20:07.841079+0000","last_clean":"2024-02-26T12:20:07.841079+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:07.841079+0000","last_undegraded":"2024-02-26T12:20:07.841079+0000","last_fullsized":"2024-02-26T12:20:07.841079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352362+0000","last_change":"2024-02-26T12:20:06.852832+0000","last_active":"2024-02-26T12:20:08.352362+0000","last_peered":"2024-02-26T12:20:08.352362+0000","last_clean":"2024-02-26T12:20:08.352362+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:08.352362+0000","last_undegraded":"2024-02-26T12:20:08.352362+0000","last_fullsized":"2024-02-26T12:20:08.352362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352062+0000","last_change":"2024-02-26T12:20:06.852324+0000","last_active":"2024-02-26T12:20:08.352062+0000","last_peered":"2024-02-26T12:20:08.352062+0000","last_clean":"2024-02-26T12:20:08.352062+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:08.352062+0000","last_undegraded":"2024-02-26T12:20:08.352062+0000","last_fullsized":"2024-02-26T12:20:08.352062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:54.685782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352961+0000","last_change":"2024-02-26T12:20:06.849421+0000","last_active":"2024-02-26T12:20:08.352961+0000","last_peered":"2024-02-26T12:20:08.352961+0000","last_clean":"2024-02-26T12:20:08.352961+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:08.352961+0000","last_undegraded":"2024-02-26T12:20:08.352961+0000","last_fullsized":"2024-02-26T12:20:08.352961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353217+0000","last_change":"2024-02-26T12:20:06.843366+0000","last_active":"2024-02-26T12:20:08.353217+0000","last_peered":"2024-02-26T12:20:08.353217+0000","last_clean":"2024-02-26T12:20:08.353217+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:08.353217+0000","last_undegraded":"2024-02-26T12:20:08.353217+0000","last_fullsized":"2024-02-26T12:20:08.353217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:25.589137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352342+0000","last_change":"2024-02-26T12:20:06.839766+0000","last_active":"2024-02-26T12:20:08.352342+0000","last_peered":"2024-02-26T12:20:08.352342+0000","last_clean":"2024-02-26T12:20:08.352342+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:08.352342+0000","last_undegraded":"2024-02-26T12:20:08.352342+0000","last_fullsized":"2024-02-26T12:20:08.352342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841973+0000","last_change":"2024-02-26T12:20:06.848927+0000","last_active":"2024-02-26T12:20:07.841973+0000","last_peered":"2024-02-26T12:20:07.841973+0000","last_clean":"2024-02-26T12:20:07.841973+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:07.841973+0000","last_undegraded":"2024-02-26T12:20:07.841973+0000","last_fullsized":"2024-02-26T12:20:07.841973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352274+0000","last_change":"2024-02-26T12:20:06.850295+0000","last_active":"2024-02-26T12:20:08.352274+0000","last_peered":"2024-02-26T12:20:08.352274+0000","last_clean":"2024-02-26T12:20:08.352274+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:08.352274+0000","last_undegraded":"2024-02-26T12:20:08.352274+0000","last_fullsized":"2024-02-26T12:20:08.352274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353066+0000","last_change":"2024-02-26T12:20:06.846792+0000","last_active":"2024-02-26T12:20:08.353066+0000","last_peered":"2024-02-26T12:20:08.353066+0000","last_clean":"2024-02-26T12:20:08.353066+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:08.353066+0000","last_undegraded":"2024-02-26T12:20:08.353066+0000","last_fullsized":"2024-02-26T12:20:08.353066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840815+0000","last_change":"2024-02-26T12:20:06.850771+0000","last_active":"2024-02-26T12:20:07.840815+0000","last_peered":"2024-02-26T12:20:07.840815+0000","last_clean":"2024-02-26T12:20:07.840815+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:07.840815+0000","last_undegraded":"2024-02-26T12:20:07.840815+0000","last_fullsized":"2024-02-26T12:20:07.840815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352210+0000","last_change":"2024-02-26T12:20:06.845105+0000","last_active":"2024-02-26T12:20:08.352210+0000","last_peered":"2024-02-26T12:20:08.352210+0000","last_clean":"2024-02-26T12:20:08.352210+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:08.352210+0000","last_undegraded":"2024-02-26T12:20:08.352210+0000","last_fullsized":"2024-02-26T12:20:08.352210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:37.707892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353101+0000","last_change":"2024-02-26T12:20:06.849132+0000","last_active":"2024-02-26T12:20:08.353101+0000","last_peered":"2024-02-26T12:20:08.353101+0000","last_clean":"2024-02-26T12:20:08.353101+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:08.353101+0000","last_undegraded":"2024-02-26T12:20:08.353101+0000","last_fullsized":"2024-02-26T12:20:08.353101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840492+0000","last_change":"2024-02-26T12:20:06.843678+0000","last_active":"2024-02-26T12:20:07.840492+0000","last_peered":"2024-02-26T12:20:07.840492+0000","last_clean":"2024-02-26T12:20:07.840492+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:07.840492+0000","last_undegraded":"2024-02-26T12:20:07.840492+0000","last_fullsized":"2024-02-26T12:20:07.840492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352649+0000","last_change":"2024-02-26T12:20:06.850419+0000","last_active":"2024-02-26T12:20:08.352649+0000","last_peered":"2024-02-26T12:20:08.352649+0000","last_clean":"2024-02-26T12:20:08.352649+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:08.352649+0000","last_undegraded":"2024-02-26T12:20:08.352649+0000","last_fullsized":"2024-02-26T12:20:08.352649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353213+0000","last_change":"2024-02-26T12:20:06.846044+0000","last_active":"2024-02-26T12:20:08.353213+0000","last_peered":"2024-02-26T12:20:08.353213+0000","last_clean":"2024-02-26T12:20:08.353213+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:08.353213+0000","last_undegraded":"2024-02-26T12:20:08.353213+0000","last_fullsized":"2024-02-26T12:20:08.353213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353380+0000","last_change":"2024-02-26T12:20:06.849063+0000","last_active":"2024-02-26T12:20:08.353380+0000","last_peered":"2024-02-26T12:20:08.353380+0000","last_clean":"2024-02-26T12:20:08.353380+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:08.353380+0000","last_undegraded":"2024-02-26T12:20:08.353380+0000","last_fullsized":"2024-02-26T12:20:08.353380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353255+0000","last_change":"2024-02-26T12:20:06.854247+0000","last_active":"2024-02-26T12:20:08.353255+0000","last_peered":"2024-02-26T12:20:08.353255+0000","last_clean":"2024-02-26T12:20:08.353255+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:08.353255+0000","last_undegraded":"2024-02-26T12:20:08.353255+0000","last_fullsized":"2024-02-26T12:20:08.353255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352391+0000","last_change":"2024-02-26T12:20:06.847720+0000","last_active":"2024-02-26T12:20:08.352391+0000","last_peered":"2024-02-26T12:20:08.352391+0000","last_clean":"2024-02-26T12:20:08.352391+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:08.352391+0000","last_undegraded":"2024-02-26T12:20:08.352391+0000","last_fullsized":"2024-02-26T12:20:08.352391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:36.567582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841645+0000","last_change":"2024-02-26T12:20:06.835429+0000","last_active":"2024-02-26T12:20:07.841645+0000","last_peered":"2024-02-26T12:20:07.841645+0000","last_clean":"2024-02-26T12:20:07.841645+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:07.841645+0000","last_undegraded":"2024-02-26T12:20:07.841645+0000","last_fullsized":"2024-02-26T12:20:07.841645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:37.928321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841332+0000","last_change":"2024-02-26T12:20:06.849789+0000","last_active":"2024-02-26T12:20:07.841332+0000","last_peered":"2024-02-26T12:20:07.841332+0000","last_clean":"2024-02-26T12:20:07.841332+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:07.841332+0000","last_undegraded":"2024-02-26T12:20:07.841332+0000","last_fullsized":"2024-02-26T12:20:07.841332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:24.470080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840193+0000","last_change":"2024-02-26T12:20:06.840392+0000","last_active":"2024-02-26T12:20:07.840193+0000","last_peered":"2024-02-26T12:20:07.840193+0000","last_clean":"2024-02-26T12:20:07.840193+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:07.840193+0000","last_undegraded":"2024-02-26T12:20:07.840193+0000","last_fullsized":"2024-02-26T12:20:07.840193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:19.601355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840620+0000","last_change":"2024-02-26T12:20:06.838075+0000","last_active":"2024-02-26T12:20:07.840620+0000","last_peered":"2024-02-26T12:20:07.840620+0000","last_clean":"2024-02-26T12:20:07.840620+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:07.840620+0000","last_undegraded":"2024-02-26T12:20:07.840620+0000","last_fullsized":"2024-02-26T12:20:07.840620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352811+0000","last_change":"2024-02-26T12:20:06.844929+0000","last_active":"2024-02-26T12:20:08.352811+0000","last_peered":"2024-02-26T12:20:08.352811+0000","last_clean":"2024-02-26T12:20:08.352811+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:08.352811+0000","last_undegraded":"2024-02-26T12:20:08.352811+0000","last_fullsized":"2024-02-26T12:20:08.352811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:49:40.985045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353454+0000","last_change":"2024-02-26T12:20:06.848784+0000","last_active":"2024-02-26T12:20:08.353454+0000","last_peered":"2024-02-26T12:20:08.353454+0000","last_clean":"2024-02-26T12:20:08.353454+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:08.353454+0000","last_undegraded":"2024-02-26T12:20:08.353454+0000","last_fullsized":"2024-02-26T12:20:08.353454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:06.852296+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:28:41.455138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840972+0000","last_change":"2024-02-26T12:20:06.834398+0000","last_active":"2024-02-26T12:20:07.840972+0000","last_peered":"2024-02-26T12:20:07.840972+0000","last_clean":"2024-02-26T12:20:07.840972+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:07.840972+0000","last_undegraded":"2024-02-26T12:20:07.840972+0000","last_fullsized":"2024-02-26T12:20:07.840972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841814+0000","last_change":"2024-02-26T12:20:06.851836+0000","last_active":"2024-02-26T12:20:07.841814+0000","last_peered":"2024-02-26T12:20:07.841814+0000","last_clean":"2024-02-26T12:20:07.841814+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:07.841814+0000","last_undegraded":"2024-02-26T12:20:07.841814+0000","last_fullsized":"2024-02-26T12:20:07.841814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352646+0000","last_change":"2024-02-26T12:20:06.840747+0000","last_active":"2024-02-26T12:20:08.352646+0000","last_peered":"2024-02-26T12:20:08.352646+0000","last_clean":"2024-02-26T12:20:08.352646+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:08.352646+0000","last_undegraded":"2024-02-26T12:20:08.352646+0000","last_fullsized":"2024-02-26T12:20:08.352646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352534+0000","last_change":"2024-02-26T12:20:06.848793+0000","last_active":"2024-02-26T12:20:08.352534+0000","last_peered":"2024-02-26T12:20:08.352534+0000","last_clean":"2024-02-26T12:20:08.352534+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:08.352534+0000","last_undegraded":"2024-02-26T12:20:08.352534+0000","last_fullsized":"2024-02-26T12:20:08.352534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352385+0000","last_change":"2024-02-26T12:20:06.846528+0000","last_active":"2024-02-26T12:20:08.352385+0000","last_peered":"2024-02-26T12:20:08.352385+0000","last_clean":"2024-02-26T12:20:08.352385+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:08.352385+0000","last_undegraded":"2024-02-26T12:20:08.352385+0000","last_fullsized":"2024-02-26T12:20:08.352385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840475+0000","last_change":"2024-02-26T12:20:06.839103+0000","last_active":"2024-02-26T12:20:07.840475+0000","last_peered":"2024-02-26T12:20:07.840475+0000","last_clean":"2024-02-26T12:20:07.840475+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:07.840475+0000","last_undegraded":"2024-02-26T12:20:07.840475+0000","last_fullsized":"2024-02-26T12:20:07.840475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353090+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:08.353090+0000","last_peered":"2024-02-26T12:20:08.353090+0000","last_clean":"2024-02-26T12:20:08.353090+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:08.353090+0000","last_undegraded":"2024-02-26T12:20:08.353090+0000","last_fullsized":"2024-02-26T12:20:08.353090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353108+0000","last_change":"2024-02-26T12:20:06.844293+0000","last_active":"2024-02-26T12:20:08.353108+0000","last_peered":"2024-02-26T12:20:08.353108+0000","last_clean":"2024-02-26T12:20:08.353108+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:08.353108+0000","last_undegraded":"2024-02-26T12:20:08.353108+0000","last_fullsized":"2024-02-26T12:20:08.353108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840380+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:07.840380+0000","last_peered":"2024-02-26T12:20:07.840380+0000","last_clean":"2024-02-26T12:20:07.840380+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:07.840380+0000","last_undegraded":"2024-02-26T12:20:07.840380+0000","last_fullsized":"2024-02-26T12:20:07.840380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842032+0000","last_change":"2024-02-26T12:20:06.851045+0000","last_active":"2024-02-26T12:20:07.842032+0000","last_peered":"2024-02-26T12:20:07.842032+0000","last_clean":"2024-02-26T12:20:07.842032+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:07.842032+0000","last_undegraded":"2024-02-26T12:20:07.842032+0000","last_fullsized":"2024-02-26T12:20:07.842032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353347+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:08.353347+0000","last_peered":"2024-02-26T12:20:08.353347+0000","last_clean":"2024-02-26T12:20:08.353347+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:08.353347+0000","last_undegraded":"2024-02-26T12:20:08.353347+0000","last_fullsized":"2024-02-26T12:20:08.353347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352989+0000","last_change":"2024-02-26T12:20:06.839258+0000","last_active":"2024-02-26T12:20:08.352989+0000","last_peered":"2024-02-26T12:20:08.352989+0000","last_clean":"2024-02-26T12:20:08.352989+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:08.352989+0000","last_undegraded":"2024-02-26T12:20:08.352989+0000","last_fullsized":"2024-02-26T12:20:08.352989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:11.744361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352472+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:08.352472+0000","last_peered":"2024-02-26T12:20:08.352472+0000","last_clean":"2024-02-26T12:20:08.352472+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:08.352472+0000","last_undegraded":"2024-02-26T12:20:08.352472+0000","last_fullsized":"2024-02-26T12:20:08.352472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:38:38.644589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:06.846106+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841764+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:07.841764+0000","last_peered":"2024-02-26T12:20:07.841764+0000","last_clean":"2024-02-26T12:20:07.841764+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:07.841764+0000","last_undegraded":"2024-02-26T12:20:07.841764+0000","last_fullsized":"2024-02-26T12:20:07.841764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840887+0000","last_change":"2024-02-26T12:20:06.835746+0000","last_active":"2024-02-26T12:20:07.840887+0000","last_peered":"2024-02-26T12:20:07.840887+0000","last_clean":"2024-02-26T12:20:07.840887+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:07.840887+0000","last_undegraded":"2024-02-26T12:20:07.840887+0000","last_fullsized":"2024-02-26T12:20:07.840887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841583+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:07.841583+0000","last_peered":"2024-02-26T12:20:07.841583+0000","last_clean":"2024-02-26T12:20:07.841583+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:07.841583+0000","last_undegraded":"2024-02-26T12:20:07.841583+0000","last_fullsized":"2024-02-26T12:20:07.841583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840817+0000","last_change":"2024-02-26T12:20:06.840340+0000","last_active":"2024-02-26T12:20:07.840817+0000","last_peered":"2024-02-26T12:20:07.840817+0000","last_clean":"2024-02-26T12:20:07.840817+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:07.840817+0000","last_undegraded":"2024-02-26T12:20:07.840817+0000","last_fullsized":"2024-02-26T12:20:07.840817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:55.795288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353065+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:08.353065+0000","last_peered":"2024-02-26T12:20:08.353065+0000","last_clean":"2024-02-26T12:20:08.353065+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:08.353065+0000","last_undegraded":"2024-02-26T12:20:08.353065+0000","last_fullsized":"2024-02-26T12:20:08.353065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:11.880880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352269+0000","last_change":"2024-02-26T12:20:06.838655+0000","last_active":"2024-02-26T12:20:08.352269+0000","last_peered":"2024-02-26T12:20:08.352269+0000","last_clean":"2024-02-26T12:20:08.352269+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:08.352269+0000","last_undegraded":"2024-02-26T12:20:08.352269+0000","last_fullsized":"2024-02-26T12:20:08.352269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840460+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:07.840460+0000","last_peered":"2024-02-26T12:20:07.840460+0000","last_clean":"2024-02-26T12:20:07.840460+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:07.840460+0000","last_undegraded":"2024-02-26T12:20:07.840460+0000","last_fullsized":"2024-02-26T12:20:07.840460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840823+0000","last_change":"2024-02-26T12:20:06.851695+0000","last_active":"2024-02-26T12:20:07.840823+0000","last_peered":"2024-02-26T12:20:07.840823+0000","last_clean":"2024-02-26T12:20:07.840823+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:07.840823+0000","last_undegraded":"2024-02-26T12:20:07.840823+0000","last_fullsized":"2024-02-26T12:20:07.840823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353626+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:08.353626+0000","last_peered":"2024-02-26T12:20:08.353626+0000","last_clean":"2024-02-26T12:20:08.353626+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:08.353626+0000","last_undegraded":"2024-02-26T12:20:08.353626+0000","last_fullsized":"2024-02-26T12:20:08.353626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353574+0000","last_change":"2024-02-26T12:20:06.852393+0000","last_active":"2024-02-26T12:20:08.353574+0000","last_peered":"2024-02-26T12:20:08.353574+0000","last_clean":"2024-02-26T12:20:08.353574+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:08.353574+0000","last_undegraded":"2024-02-26T12:20:08.353574+0000","last_fullsized":"2024-02-26T12:20:08.353574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840482+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:07.840482+0000","last_peered":"2024-02-26T12:20:07.840482+0000","last_clean":"2024-02-26T12:20:07.840482+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:07.840482+0000","last_undegraded":"2024-02-26T12:20:07.840482+0000","last_fullsized":"2024-02-26T12:20:07.840482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352771+0000","last_change":"2024-02-26T12:20:06.849481+0000","last_active":"2024-02-26T12:20:08.352771+0000","last_peered":"2024-02-26T12:20:08.352771+0000","last_clean":"2024-02-26T12:20:08.352771+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:08.352771+0000","last_undegraded":"2024-02-26T12:20:08.352771+0000","last_fullsized":"2024-02-26T12:20:08.352771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841138+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:07.841138+0000","last_peered":"2024-02-26T12:20:07.841138+0000","last_clean":"2024-02-26T12:20:07.841138+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:07.841138+0000","last_undegraded":"2024-02-26T12:20:07.841138+0000","last_fullsized":"2024-02-26T12:20:07.841138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841041+0000","last_change":"2024-02-26T12:20:06.834421+0000","last_active":"2024-02-26T12:20:07.841041+0000","last_peered":"2024-02-26T12:20:07.841041+0000","last_clean":"2024-02-26T12:20:07.841041+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:07.841041+0000","last_undegraded":"2024-02-26T12:20:07.841041+0000","last_fullsized":"2024-02-26T12:20:07.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352871+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:08.352871+0000","last_peered":"2024-02-26T12:20:08.352871+0000","last_clean":"2024-02-26T12:20:08.352871+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:08.352871+0000","last_undegraded":"2024-02-26T12:20:08.352871+0000","last_fullsized":"2024-02-26T12:20:08.352871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353078+0000","last_change":"2024-02-26T12:20:06.841973+0000","last_active":"2024-02-26T12:20:08.353078+0000","last_peered":"2024-02-26T12:20:08.353078+0000","last_clean":"2024-02-26T12:20:08.353078+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:08.353078+0000","last_undegraded":"2024-02-26T12:20:08.353078+0000","last_fullsized":"2024-02-26T12:20:08.353078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:04:12.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841896+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:07.841896+0000","last_peered":"2024-02-26T12:20:07.841896+0000","last_clean":"2024-02-26T12:20:07.841896+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:07.841896+0000","last_undegraded":"2024-02-26T12:20:07.841896+0000","last_fullsized":"2024-02-26T12:20:07.841896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353613+0000","last_change":"2024-02-26T12:20:06.849714+0000","last_active":"2024-02-26T12:20:08.353613+0000","last_peered":"2024-02-26T12:20:08.353613+0000","last_clean":"2024-02-26T12:20:08.353613+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:08.353613+0000","last_undegraded":"2024-02-26T12:20:08.353613+0000","last_fullsized":"2024-02-26T12:20:08.353613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352543+0000","last_change":"2024-02-26T12:20:06.846095+0000","last_active":"2024-02-26T12:20:08.352543+0000","last_peered":"2024-02-26T12:20:08.352543+0000","last_clean":"2024-02-26T12:20:08.352543+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:08.352543+0000","last_undegraded":"2024-02-26T12:20:08.352543+0000","last_fullsized":"2024-02-26T12:20:08.352543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353073+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:08.353073+0000","last_peered":"2024-02-26T12:20:08.353073+0000","last_clean":"2024-02-26T12:20:08.353073+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:08.353073+0000","last_undegraded":"2024-02-26T12:20:08.353073+0000","last_fullsized":"2024-02-26T12:20:08.353073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:49.632494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352570+0000","last_change":"2024-02-26T12:20:06.844305+0000","last_active":"2024-02-26T12:20:08.352570+0000","last_peered":"2024-02-26T12:20:08.352570+0000","last_clean":"2024-02-26T12:20:08.352570+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:08.352570+0000","last_undegraded":"2024-02-26T12:20:08.352570+0000","last_fullsized":"2024-02-26T12:20:08.352570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:34.562401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841724+0000","last_change":"2024-02-26T12:20:06.836689+0000","last_active":"2024-02-26T12:20:07.841724+0000","last_peered":"2024-02-26T12:20:07.841724+0000","last_clean":"2024-02-26T12:20:07.841724+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:07.841724+0000","last_undegraded":"2024-02-26T12:20:07.841724+0000","last_fullsized":"2024-02-26T12:20:07.841724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352972+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:08.352972+0000","last_peered":"2024-02-26T12:20:08.352972+0000","last_clean":"2024-02-26T12:20:08.352972+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:08.352972+0000","last_undegraded":"2024-02-26T12:20:08.352972+0000","last_fullsized":"2024-02-26T12:20:08.352972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841468+0000","last_change":"2024-02-26T12:20:06.847756+0000","last_active":"2024-02-26T12:20:07.841468+0000","last_peered":"2024-02-26T12:20:07.841468+0000","last_clean":"2024-02-26T12:20:07.841468+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:07.841468+0000","last_undegraded":"2024-02-26T12:20:07.841468+0000","last_fullsized":"2024-02-26T12:20:07.841468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841807+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:07.841807+0000","last_peered":"2024-02-26T12:20:07.841807+0000","last_clean":"2024-02-26T12:20:07.841807+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:07.841807+0000","last_undegraded":"2024-02-26T12:20:07.841807+0000","last_fullsized":"2024-02-26T12:20:07.841807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352439+0000","last_change":"2024-02-26T12:20:06.851971+0000","last_active":"2024-02-26T12:20:08.352439+0000","last_peered":"2024-02-26T12:20:08.352439+0000","last_clean":"2024-02-26T12:20:08.352439+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:08.352439+0000","last_undegraded":"2024-02-26T12:20:08.352439+0000","last_fullsized":"2024-02-26T12:20:08.352439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841761+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:07.841761+0000","last_peered":"2024-02-26T12:20:07.841761+0000","last_clean":"2024-02-26T12:20:07.841761+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:07.841761+0000","last_undegraded":"2024-02-26T12:20:07.841761+0000","last_fullsized":"2024-02-26T12:20:07.841761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352170+0000","last_change":"2024-02-26T12:20:06.841194+0000","last_active":"2024-02-26T12:20:08.352170+0000","last_peered":"2024-02-26T12:20:08.352170+0000","last_clean":"2024-02-26T12:20:08.352170+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:08.352170+0000","last_undegraded":"2024-02-26T12:20:08.352170+0000","last_fullsized":"2024-02-26T12:20:08.352170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:36.378565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842034+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:07.842034+0000","last_peered":"2024-02-26T12:20:07.842034+0000","last_clean":"2024-02-26T12:20:07.842034+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:07.842034+0000","last_undegraded":"2024-02-26T12:20:07.842034+0000","last_fullsized":"2024-02-26T12:20:07.842034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.841086+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:45.667456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840347+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:07.840347+0000","last_peered":"2024-02-26T12:20:07.840347+0000","last_clean":"2024-02-26T12:20:07.840347+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:07.840347+0000","last_undegraded":"2024-02-26T12:20:07.840347+0000","last_fullsized":"2024-02-26T12:20:07.840347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352358+0000","last_change":"2024-02-26T12:20:06.847035+0000","last_active":"2024-02-26T12:20:08.352358+0000","last_peered":"2024-02-26T12:20:08.352358+0000","last_clean":"2024-02-26T12:20:08.352358+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:08.352358+0000","last_undegraded":"2024-02-26T12:20:08.352358+0000","last_fullsized":"2024-02-26T12:20:08.352358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:44.444191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352952+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:08.352952+0000","last_peered":"2024-02-26T12:20:08.352952+0000","last_clean":"2024-02-26T12:20:08.352952+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:08.352952+0000","last_undegraded":"2024-02-26T12:20:08.352952+0000","last_fullsized":"2024-02-26T12:20:08.352952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.351951+0000","last_change":"2024-02-26T12:20:06.836131+0000","last_active":"2024-02-26T12:20:08.351951+0000","last_peered":"2024-02-26T12:20:08.351951+0000","last_clean":"2024-02-26T12:20:08.351951+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:08.351951+0000","last_undegraded":"2024-02-26T12:20:08.351951+0000","last_fullsized":"2024-02-26T12:20:08.351951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:37.734794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841367+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:07.841367+0000","last_peered":"2024-02-26T12:20:07.841367+0000","last_clean":"2024-02-26T12:20:07.841367+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:07.841367+0000","last_undegraded":"2024-02-26T12:20:07.841367+0000","last_fullsized":"2024-02-26T12:20:07.841367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352683+0000","last_change":"2024-02-26T12:20:06.843136+0000","last_active":"2024-02-26T12:20:08.352683+0000","last_peered":"2024-02-26T12:20:08.352683+0000","last_clean":"2024-02-26T12:20:08.352683+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:08.352683+0000","last_undegraded":"2024-02-26T12:20:08.352683+0000","last_fullsized":"2024-02-26T12:20:08.352683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840292+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:07.840292+0000","last_peered":"2024-02-26T12:20:07.840292+0000","last_clean":"2024-02-26T12:20:07.840292+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:07.840292+0000","last_undegraded":"2024-02-26T12:20:07.840292+0000","last_fullsized":"2024-02-26T12:20:07.840292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.843988+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:15.222912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353068+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:08.353068+0000","last_peered":"2024-02-26T12:20:08.353068+0000","last_clean":"2024-02-26T12:20:08.353068+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:08.353068+0000","last_undegraded":"2024-02-26T12:20:08.353068+0000","last_fullsized":"2024-02-26T12:20:08.353068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841445+0000","last_change":"2024-02-26T12:20:06.846498+0000","last_active":"2024-02-26T12:20:07.841445+0000","last_peered":"2024-02-26T12:20:07.841445+0000","last_clean":"2024-02-26T12:20:07.841445+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:07.841445+0000","last_undegraded":"2024-02-26T12:20:07.841445+0000","last_fullsized":"2024-02-26T12:20:07.841445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840598+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:07.840598+0000","last_peered":"2024-02-26T12:20:07.840598+0000","last_clean":"2024-02-26T12:20:07.840598+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:07.840598+0000","last_undegraded":"2024-02-26T12:20:07.840598+0000","last_fullsized":"2024-02-26T12:20:07.840598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840309+0000","last_change":"2024-02-26T12:20:06.840249+0000","last_active":"2024-02-26T12:20:07.840309+0000","last_peered":"2024-02-26T12:20:07.840309+0000","last_clean":"2024-02-26T12:20:07.840309+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:07.840309+0000","last_undegraded":"2024-02-26T12:20:07.840309+0000","last_fullsized":"2024-02-26T12:20:07.840309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352525+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:08.352525+0000","last_peered":"2024-02-26T12:20:08.352525+0000","last_clean":"2024-02-26T12:20:08.352525+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:08.352525+0000","last_undegraded":"2024-02-26T12:20:08.352525+0000","last_fullsized":"2024-02-26T12:20:08.352525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352648+0000","last_change":"2024-02-26T12:20:06.844149+0000","last_active":"2024-02-26T12:20:08.352648+0000","last_peered":"2024-02-26T12:20:08.352648+0000","last_clean":"2024-02-26T12:20:08.352648+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:08.352648+0000","last_undegraded":"2024-02-26T12:20:08.352648+0000","last_fullsized":"2024-02-26T12:20:08.352648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840470+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:07.840470+0000","last_peered":"2024-02-26T12:20:07.840470+0000","last_clean":"2024-02-26T12:20:07.840470+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:07.840470+0000","last_undegraded":"2024-02-26T12:20:07.840470+0000","last_fullsized":"2024-02-26T12:20:07.840470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840357+0000","last_change":"2024-02-26T12:20:06.846886+0000","last_active":"2024-02-26T12:20:07.840357+0000","last_peered":"2024-02-26T12:20:07.840357+0000","last_clean":"2024-02-26T12:20:07.840357+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:07.840357+0000","last_undegraded":"2024-02-26T12:20:07.840357+0000","last_fullsized":"2024-02-26T12:20:07.840357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353099+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:08.353099+0000","last_peered":"2024-02-26T12:20:08.353099+0000","last_clean":"2024-02-26T12:20:08.353099+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:08.353099+0000","last_undegraded":"2024-02-26T12:20:08.353099+0000","last_fullsized":"2024-02-26T12:20:08.353099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352712+0000","last_change":"2024-02-26T12:20:06.849839+0000","last_active":"2024-02-26T12:20:08.352712+0000","last_peered":"2024-02-26T12:20:08.352712+0000","last_clean":"2024-02-26T12:20:08.352712+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:08.352712+0000","last_undegraded":"2024-02-26T12:20:08.352712+0000","last_fullsized":"2024-02-26T12:20:08.352712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841436+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:07.841436+0000","last_peered":"2024-02-26T12:20:07.841436+0000","last_clean":"2024-02-26T12:20:07.841436+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:07.841436+0000","last_undegraded":"2024-02-26T12:20:07.841436+0000","last_fullsized":"2024-02-26T12:20:07.841436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840423+0000","last_change":"2024-02-26T12:20:06.849696+0000","last_active":"2024-02-26T12:20:07.840423+0000","last_peered":"2024-02-26T12:20:07.840423+0000","last_clean":"2024-02-26T12:20:07.840423+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:07.840423+0000","last_undegraded":"2024-02-26T12:20:07.840423+0000","last_fullsized":"2024-02-26T12:20:07.840423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352941+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:08.352941+0000","last_peered":"2024-02-26T12:20:08.352941+0000","last_clean":"2024-02-26T12:20:08.352941+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:08.352941+0000","last_undegraded":"2024-02-26T12:20:08.352941+0000","last_fullsized":"2024-02-26T12:20:08.352941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352828+0000","last_change":"2024-02-26T12:20:06.839596+0000","last_active":"2024-02-26T12:20:08.352828+0000","last_peered":"2024-02-26T12:20:08.352828+0000","last_clean":"2024-02-26T12:20:08.352828+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:08.352828+0000","last_undegraded":"2024-02-26T12:20:08.352828+0000","last_fullsized":"2024-02-26T12:20:08.352828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352875+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:08.352875+0000","last_peered":"2024-02-26T12:20:08.352875+0000","last_clean":"2024-02-26T12:20:08.352875+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:08.352875+0000","last_undegraded":"2024-02-26T12:20:08.352875+0000","last_fullsized":"2024-02-26T12:20:08.352875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352681+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:08.352681+0000","last_peered":"2024-02-26T12:20:08.352681+0000","last_clean":"2024-02-26T12:20:08.352681+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:08.352681+0000","last_undegraded":"2024-02-26T12:20:08.352681+0000","last_fullsized":"2024-02-26T12:20:08.352681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:22.071 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:22.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.223+0000 7f426982d640 1 Processor -- start 2024-02-26T12:20:22.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.223+0000 7f426982d640 1 -- start start 2024-02-26T12:20:22.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f426982d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42640b2d80 0x7f42640d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f426982d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42640d3530 0x7f42640ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f426982d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640d1f50 con 0x7f426415def0 2024-02-26T12:20:22.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f426982d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640d2230 con 0x7f42640b2d80 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f426982d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640d2510 con 0x7f42640d3530 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f42627fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42640b2d80 0x7f42640d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f42627fc640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f42640b2d80 0x7f42640d2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43852/0 (socket says 172.21.15.113:43852) 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f42627fc640 1 -- 172.21.15.113:0/2263903192 learned_addr learned my addr 172.21.15.113:0/2263903192 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.224+0000 7f42637fe640 1 --2- 172.21.15.113:0/2263903192 >> v2:172.21.15.152:3300/0 conn(0x7f42640d3530 0x7f42640ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f42627fc640 1 -- 172.21.15.113:0/2263903192 >> v2:172.21.15.152:3300/0 conn(0x7f42640d3530 msgr2=0x7f42640ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f42627fc640 1 --2- 172.21.15.113:0/2263903192 >> v2:172.21.15.152:3300/0 conn(0x7f42640d3530 0x7f42640ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f42627fc640 1 -- 172.21.15.113:0/2263903192 >> v1:172.21.15.152:6789/0 conn(0x7f426415def0 legacy=0x7f42640b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f42627fc640 1 -- 172.21.15.113:0/2263903192 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640d27f0 con 0x7f42640b2d80 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f42627fc640 1 --2- 172.21.15.113:0/2263903192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640b2d80 0x7f42640d2ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4258009870 tx=0x7f425802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8057ccf187432180 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f4261ffb640 1 -- 172.21.15.113:0/2263903192 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258034070 con 0x7f42640b2d80 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f4261ffb640 1 -- 172.21.15.113:0/2263903192 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258030860 con 0x7f42640b2d80 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.225+0000 7f4261ffb640 1 -- 172.21.15.113:0/2263903192 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258030c30 con 0x7f42640b2d80 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 -- 172.21.15.113:0/2263903192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640b2d80 msgr2=0x7f42640d2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 --2- 172.21.15.113:0/2263903192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640b2d80 0x7f42640d2ff0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4258009870 tx=0x7f425802b9a0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 -- 172.21.15.113:0/2263903192 shutdown_connections 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 --2- 172.21.15.113:0/2263903192 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640b2d80 0x7f42640d2ff0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 --2- 172.21.15.113:0/2263903192 >> v2:172.21.15.152:3300/0 conn(0x7f42640d3530 0x7f42640ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 -- 172.21.15.113:0/2263903192 >> 172.21.15.113:0/2263903192 conn(0x7f42640728b0 msgr2=0x7f42640d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 -- 172.21.15.113:0/2263903192 shutdown_connections 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.226+0000 7f426982d640 1 -- 172.21.15.113:0/2263903192 wait complete. 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.227+0000 7f426982d640 1 Processor -- start 2024-02-26T12:20:22.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.227+0000 7f426982d640 1 -- start start 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42640b2d80 0x7f42640cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42640d3530 0x7f42640cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cef70 con 0x7f42640c9b70 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cedf0 con 0x7f42640d3530 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f426982d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cf0f0 con 0x7f42640b2d80 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43860/0 (socket says 172.21.15.113:43860) 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 -- 172.21.15.113:0/3312940648 learned_addr learned my addr 172.21.15.113:0/3312940648 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 -- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42640b2d80 msgr2=0x7f42640cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42640b2d80 0x7f42640cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 -- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42640d3530 msgr2=0x7f42640cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42640d3530 0x7f42640cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.228+0000 7f42637fe640 1 -- 172.21.15.113:0/3312940648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640cce90 con 0x7f42640c9b70 2024-02-26T12:20:22.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f42637fe640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e820 tx=0x7f425c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c017070 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00ee70 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42640cd170 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00cb60 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.229+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640cd730 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.230+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4264074a50 con 0x7f42640c9b70 2024-02-26T12:20:22.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.230+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f425c01a070 con 0x7f42640c9b70 2024-02-26T12:20:22.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.230+0000 7f424bfff640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 0x7f425006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.231+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f425c08a160 con 0x7f42640c9b70 2024-02-26T12:20:22.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.231+0000 7f4262ffd640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 0x7f425006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.231+0000 7f4262ffd640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 0x7f425006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42540012e0 tx=0x7f4254007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.235+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f425c058fe0 con 0x7f42640c9b70 2024-02-26T12:20:22.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.401+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42640b24a0 con 0x7f425006b4d0 2024-02-26T12:20:22.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.407+0000 7f424bfff640 1 -- 172.21.15.113:0/3312940648 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7f42640b24a0 con 0x7f425006b4d0 2024-02-26T12:20:22.395 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:22.396 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:22.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 msgr2=0x7f425006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 0x7f425006d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f42540012e0 tx=0x7f4254007d50 comp rx=0 tx=0).stop 2024-02-26T12:20:22.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 msgr2=0x7f426415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f425c00e820 tx=0x7f425c00ec20 comp rx=0 tx=0).stop 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 shutdown_connections 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f425006b4d0 0x7f425006d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f42640c9b70 0x7f426415ff00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42640d3530 0x7f42640cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 --2- 172.21.15.113:0/3312940648 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42640b2d80 0x7f42640cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 >> 172.21.15.113:0/3312940648 conn(0x7f42640728b0 msgr2=0x7f42640d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 shutdown_connections 2024-02-26T12:20:22.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.410+0000 7f426982d640 1 -- 172.21.15.113:0/3312940648 wait complete. 2024-02-26T12:20:22.406 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-02-26T12:20:21.168508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220108,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754612,"statfs":{"total":773094113280,"available":772868722688,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003537"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352976+0000","last_change":"2024-02-26T12:20:06.844968+0000","last_active":"2024-02-26T12:20:08.352976+0000","last_peered":"2024-02-26T12:20:08.352976+0000","last_clean":"2024-02-26T12:20:08.352976+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:08.352976+0000","last_undegraded":"2024-02-26T12:20:08.352976+0000","last_fullsized":"2024-02-26T12:20:08.352976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:50.636359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353304+0000","last_change":"2024-02-26T12:20:06.849184+0000","last_active":"2024-02-26T12:20:08.353304+0000","last_peered":"2024-02-26T12:20:08.353304+0000","last_clean":"2024-02-26T12:20:08.353304+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:08.353304+0000","last_undegraded":"2024-02-26T12:20:08.353304+0000","last_fullsized":"2024-02-26T12:20:08.353304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841079+0000","last_change":"2024-02-26T12:20:06.834964+0000","last_active":"2024-02-26T12:20:07.841079+0000","last_peered":"2024-02-26T12:20:07.841079+0000","last_clean":"2024-02-26T12:20:07.841079+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:07.841079+0000","last_undegraded":"2024-02-26T12:20:07.841079+0000","last_fullsized":"2024-02-26T12:20:07.841079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352362+0000","last_change":"2024-02-26T12:20:06.852832+0000","last_active":"2024-02-26T12:20:08.352362+0000","last_peered":"2024-02-26T12:20:08.352362+0000","last_clean":"2024-02-26T12:20:08.352362+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:08.352362+0000","last_undegraded":"2024-02-26T12:20:08.352362+0000","last_fullsized":"2024-02-26T12:20:08.352362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352062+0000","last_change":"2024-02-26T12:20:06.852324+0000","last_active":"2024-02-26T12:20:08.352062+0000","last_peered":"2024-02-26T12:20:08.352062+0000","last_clean":"2024-02-26T12:20:08.352062+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:08.352062+0000","last_undegraded":"2024-02-26T12:20:08.352062+0000","last_fullsized":"2024-02-26T12:20:08.352062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:54.685782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352961+0000","last_change":"2024-02-26T12:20:06.849421+0000","last_active":"2024-02-26T12:20:08.352961+0000","last_peered":"2024-02-26T12:20:08.352961+0000","last_clean":"2024-02-26T12:20:08.352961+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:08.352961+0000","last_undegraded":"2024-02-26T12:20:08.352961+0000","last_fullsized":"2024-02-26T12:20:08.352961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353217+0000","last_change":"2024-02-26T12:20:06.843366+0000","last_active":"2024-02-26T12:20:08.353217+0000","last_peered":"2024-02-26T12:20:08.353217+0000","last_clean":"2024-02-26T12:20:08.353217+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:08.353217+0000","last_undegraded":"2024-02-26T12:20:08.353217+0000","last_fullsized":"2024-02-26T12:20:08.353217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:25.589137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352342+0000","last_change":"2024-02-26T12:20:06.839766+0000","last_active":"2024-02-26T12:20:08.352342+0000","last_peered":"2024-02-26T12:20:08.352342+0000","last_clean":"2024-02-26T12:20:08.352342+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:08.352342+0000","last_undegraded":"2024-02-26T12:20:08.352342+0000","last_fullsized":"2024-02-26T12:20:08.352342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841973+0000","last_change":"2024-02-26T12:20:06.848927+0000","last_active":"2024-02-26T12:20:07.841973+0000","last_peered":"2024-02-26T12:20:07.841973+0000","last_clean":"2024-02-26T12:20:07.841973+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:07.841973+0000","last_undegraded":"2024-02-26T12:20:07.841973+0000","last_fullsized":"2024-02-26T12:20:07.841973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352274+0000","last_change":"2024-02-26T12:20:06.850295+0000","last_active":"2024-02-26T12:20:08.352274+0000","last_peered":"2024-02-26T12:20:08.352274+0000","last_clean":"2024-02-26T12:20:08.352274+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:08.352274+0000","last_undegraded":"2024-02-26T12:20:08.352274+0000","last_fullsized":"2024-02-26T12:20:08.352274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353066+0000","last_change":"2024-02-26T12:20:06.846792+0000","last_active":"2024-02-26T12:20:08.353066+0000","last_peered":"2024-02-26T12:20:08.353066+0000","last_clean":"2024-02-26T12:20:08.353066+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:08.353066+0000","last_undegraded":"2024-02-26T12:20:08.353066+0000","last_fullsized":"2024-02-26T12:20:08.353066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840815+0000","last_change":"2024-02-26T12:20:06.850771+0000","last_active":"2024-02-26T12:20:07.840815+0000","last_peered":"2024-02-26T12:20:07.840815+0000","last_clean":"2024-02-26T12:20:07.840815+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:07.840815+0000","last_undegraded":"2024-02-26T12:20:07.840815+0000","last_fullsized":"2024-02-26T12:20:07.840815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352210+0000","last_change":"2024-02-26T12:20:06.845105+0000","last_active":"2024-02-26T12:20:08.352210+0000","last_peered":"2024-02-26T12:20:08.352210+0000","last_clean":"2024-02-26T12:20:08.352210+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:08.352210+0000","last_undegraded":"2024-02-26T12:20:08.352210+0000","last_fullsized":"2024-02-26T12:20:08.352210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:37.707892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353101+0000","last_change":"2024-02-26T12:20:06.849132+0000","last_active":"2024-02-26T12:20:08.353101+0000","last_peered":"2024-02-26T12:20:08.353101+0000","last_clean":"2024-02-26T12:20:08.353101+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:08.353101+0000","last_undegraded":"2024-02-26T12:20:08.353101+0000","last_fullsized":"2024-02-26T12:20:08.353101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840492+0000","last_change":"2024-02-26T12:20:06.843678+0000","last_active":"2024-02-26T12:20:07.840492+0000","last_peered":"2024-02-26T12:20:07.840492+0000","last_clean":"2024-02-26T12:20:07.840492+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:07.840492+0000","last_undegraded":"2024-02-26T12:20:07.840492+0000","last_fullsized":"2024-02-26T12:20:07.840492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352649+0000","last_change":"2024-02-26T12:20:06.850419+0000","last_active":"2024-02-26T12:20:08.352649+0000","last_peered":"2024-02-26T12:20:08.352649+0000","last_clean":"2024-02-26T12:20:08.352649+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:08.352649+0000","last_undegraded":"2024-02-26T12:20:08.352649+0000","last_fullsized":"2024-02-26T12:20:08.352649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353213+0000","last_change":"2024-02-26T12:20:06.846044+0000","last_active":"2024-02-26T12:20:08.353213+0000","last_peered":"2024-02-26T12:20:08.353213+0000","last_clean":"2024-02-26T12:20:08.353213+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:08.353213+0000","last_undegraded":"2024-02-26T12:20:08.353213+0000","last_fullsized":"2024-02-26T12:20:08.353213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353380+0000","last_change":"2024-02-26T12:20:06.849063+0000","last_active":"2024-02-26T12:20:08.353380+0000","last_peered":"2024-02-26T12:20:08.353380+0000","last_clean":"2024-02-26T12:20:08.353380+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:08.353380+0000","last_undegraded":"2024-02-26T12:20:08.353380+0000","last_fullsized":"2024-02-26T12:20:08.353380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353255+0000","last_change":"2024-02-26T12:20:06.854247+0000","last_active":"2024-02-26T12:20:08.353255+0000","last_peered":"2024-02-26T12:20:08.353255+0000","last_clean":"2024-02-26T12:20:08.353255+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:08.353255+0000","last_undegraded":"2024-02-26T12:20:08.353255+0000","last_fullsized":"2024-02-26T12:20:08.353255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352391+0000","last_change":"2024-02-26T12:20:06.847720+0000","last_active":"2024-02-26T12:20:08.352391+0000","last_peered":"2024-02-26T12:20:08.352391+0000","last_clean":"2024-02-26T12:20:08.352391+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:08.352391+0000","last_undegraded":"2024-02-26T12:20:08.352391+0000","last_fullsized":"2024-02-26T12:20:08.352391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:36.567582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841645+0000","last_change":"2024-02-26T12:20:06.835429+0000","last_active":"2024-02-26T12:20:07.841645+0000","last_peered":"2024-02-26T12:20:07.841645+0000","last_clean":"2024-02-26T12:20:07.841645+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:07.841645+0000","last_undegraded":"2024-02-26T12:20:07.841645+0000","last_fullsized":"2024-02-26T12:20:07.841645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:37.928321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841332+0000","last_change":"2024-02-26T12:20:06.849789+0000","last_active":"2024-02-26T12:20:07.841332+0000","last_peered":"2024-02-26T12:20:07.841332+0000","last_clean":"2024-02-26T12:20:07.841332+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:07.841332+0000","last_undegraded":"2024-02-26T12:20:07.841332+0000","last_fullsized":"2024-02-26T12:20:07.841332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:24.470080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840193+0000","last_change":"2024-02-26T12:20:06.840392+0000","last_active":"2024-02-26T12:20:07.840193+0000","last_peered":"2024-02-26T12:20:07.840193+0000","last_clean":"2024-02-26T12:20:07.840193+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:07.840193+0000","last_undegraded":"2024-02-26T12:20:07.840193+0000","last_fullsized":"2024-02-26T12:20:07.840193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:19.601355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840620+0000","last_change":"2024-02-26T12:20:06.838075+0000","last_active":"2024-02-26T12:20:07.840620+0000","last_peered":"2024-02-26T12:20:07.840620+0000","last_clean":"2024-02-26T12:20:07.840620+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:07.840620+0000","last_undegraded":"2024-02-26T12:20:07.840620+0000","last_fullsized":"2024-02-26T12:20:07.840620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352811+0000","last_change":"2024-02-26T12:20:06.844929+0000","last_active":"2024-02-26T12:20:08.352811+0000","last_peered":"2024-02-26T12:20:08.352811+0000","last_clean":"2024-02-26T12:20:08.352811+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:08.352811+0000","last_undegraded":"2024-02-26T12:20:08.352811+0000","last_fullsized":"2024-02-26T12:20:08.352811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:49:40.985045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353454+0000","last_change":"2024-02-26T12:20:06.848784+0000","last_active":"2024-02-26T12:20:08.353454+0000","last_peered":"2024-02-26T12:20:08.353454+0000","last_clean":"2024-02-26T12:20:08.353454+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:08.353454+0000","last_undegraded":"2024-02-26T12:20:08.353454+0000","last_fullsized":"2024-02-26T12:20:08.353454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:06.852296+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:28:41.455138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840972+0000","last_change":"2024-02-26T12:20:06.834398+0000","last_active":"2024-02-26T12:20:07.840972+0000","last_peered":"2024-02-26T12:20:07.840972+0000","last_clean":"2024-02-26T12:20:07.840972+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:07.840972+0000","last_undegraded":"2024-02-26T12:20:07.840972+0000","last_fullsized":"2024-02-26T12:20:07.840972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841814+0000","last_change":"2024-02-26T12:20:06.851836+0000","last_active":"2024-02-26T12:20:07.841814+0000","last_peered":"2024-02-26T12:20:07.841814+0000","last_clean":"2024-02-26T12:20:07.841814+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:07.841814+0000","last_undegraded":"2024-02-26T12:20:07.841814+0000","last_fullsized":"2024-02-26T12:20:07.841814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352646+0000","last_change":"2024-02-26T12:20:06.840747+0000","last_active":"2024-02-26T12:20:08.352646+0000","last_peered":"2024-02-26T12:20:08.352646+0000","last_clean":"2024-02-26T12:20:08.352646+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:08.352646+0000","last_undegraded":"2024-02-26T12:20:08.352646+0000","last_fullsized":"2024-02-26T12:20:08.352646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352534+0000","last_change":"2024-02-26T12:20:06.848793+0000","last_active":"2024-02-26T12:20:08.352534+0000","last_peered":"2024-02-26T12:20:08.352534+0000","last_clean":"2024-02-26T12:20:08.352534+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:08.352534+0000","last_undegraded":"2024-02-26T12:20:08.352534+0000","last_fullsized":"2024-02-26T12:20:08.352534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352385+0000","last_change":"2024-02-26T12:20:06.846528+0000","last_active":"2024-02-26T12:20:08.352385+0000","last_peered":"2024-02-26T12:20:08.352385+0000","last_clean":"2024-02-26T12:20:08.352385+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:08.352385+0000","last_undegraded":"2024-02-26T12:20:08.352385+0000","last_fullsized":"2024-02-26T12:20:08.352385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840475+0000","last_change":"2024-02-26T12:20:06.839103+0000","last_active":"2024-02-26T12:20:07.840475+0000","last_peered":"2024-02-26T12:20:07.840475+0000","last_clean":"2024-02-26T12:20:07.840475+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:07.840475+0000","last_undegraded":"2024-02-26T12:20:07.840475+0000","last_fullsized":"2024-02-26T12:20:07.840475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353090+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:08.353090+0000","last_peered":"2024-02-26T12:20:08.353090+0000","last_clean":"2024-02-26T12:20:08.353090+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:08.353090+0000","last_undegraded":"2024-02-26T12:20:08.353090+0000","last_fullsized":"2024-02-26T12:20:08.353090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353108+0000","last_change":"2024-02-26T12:20:06.844293+0000","last_active":"2024-02-26T12:20:08.353108+0000","last_peered":"2024-02-26T12:20:08.353108+0000","last_clean":"2024-02-26T12:20:08.353108+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:08.353108+0000","last_undegraded":"2024-02-26T12:20:08.353108+0000","last_fullsized":"2024-02-26T12:20:08.353108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840380+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:07.840380+0000","last_peered":"2024-02-26T12:20:07.840380+0000","last_clean":"2024-02-26T12:20:07.840380+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:07.840380+0000","last_undegraded":"2024-02-26T12:20:07.840380+0000","last_fullsized":"2024-02-26T12:20:07.840380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842032+0000","last_change":"2024-02-26T12:20:06.851045+0000","last_active":"2024-02-26T12:20:07.842032+0000","last_peered":"2024-02-26T12:20:07.842032+0000","last_clean":"2024-02-26T12:20:07.842032+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:07.842032+0000","last_undegraded":"2024-02-26T12:20:07.842032+0000","last_fullsized":"2024-02-26T12:20:07.842032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353347+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:08.353347+0000","last_peered":"2024-02-26T12:20:08.353347+0000","last_clean":"2024-02-26T12:20:08.353347+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:08.353347+0000","last_undegraded":"2024-02-26T12:20:08.353347+0000","last_fullsized":"2024-02-26T12:20:08.353347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352989+0000","last_change":"2024-02-26T12:20:06.839258+0000","last_active":"2024-02-26T12:20:08.352989+0000","last_peered":"2024-02-26T12:20:08.352989+0000","last_clean":"2024-02-26T12:20:08.352989+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:08.352989+0000","last_undegraded":"2024-02-26T12:20:08.352989+0000","last_fullsized":"2024-02-26T12:20:08.352989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:11.744361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352472+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:08.352472+0000","last_peered":"2024-02-26T12:20:08.352472+0000","last_clean":"2024-02-26T12:20:08.352472+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:08.352472+0000","last_undegraded":"2024-02-26T12:20:08.352472+0000","last_fullsized":"2024-02-26T12:20:08.352472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:38:38.644589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:06.846106+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841764+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:07.841764+0000","last_peered":"2024-02-26T12:20:07.841764+0000","last_clean":"2024-02-26T12:20:07.841764+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:07.841764+0000","last_undegraded":"2024-02-26T12:20:07.841764+0000","last_fullsized":"2024-02-26T12:20:07.841764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840887+0000","last_change":"2024-02-26T12:20:06.835746+0000","last_active":"2024-02-26T12:20:07.840887+0000","last_peered":"2024-02-26T12:20:07.840887+0000","last_clean":"2024-02-26T12:20:07.840887+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:07.840887+0000","last_undegraded":"2024-02-26T12:20:07.840887+0000","last_fullsized":"2024-02-26T12:20:07.840887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841583+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:07.841583+0000","last_peered":"2024-02-26T12:20:07.841583+0000","last_clean":"2024-02-26T12:20:07.841583+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:07.841583+0000","last_undegraded":"2024-02-26T12:20:07.841583+0000","last_fullsized":"2024-02-26T12:20:07.841583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840817+0000","last_change":"2024-02-26T12:20:06.840340+0000","last_active":"2024-02-26T12:20:07.840817+0000","last_peered":"2024-02-26T12:20:07.840817+0000","last_clean":"2024-02-26T12:20:07.840817+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:07.840817+0000","last_undegraded":"2024-02-26T12:20:07.840817+0000","last_fullsized":"2024-02-26T12:20:07.840817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:55.795288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353065+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:08.353065+0000","last_peered":"2024-02-26T12:20:08.353065+0000","last_clean":"2024-02-26T12:20:08.353065+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:08.353065+0000","last_undegraded":"2024-02-26T12:20:08.353065+0000","last_fullsized":"2024-02-26T12:20:08.353065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:11.880880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352269+0000","last_change":"2024-02-26T12:20:06.838655+0000","last_active":"2024-02-26T12:20:08.352269+0000","last_peered":"2024-02-26T12:20:08.352269+0000","last_clean":"2024-02-26T12:20:08.352269+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:08.352269+0000","last_undegraded":"2024-02-26T12:20:08.352269+0000","last_fullsized":"2024-02-26T12:20:08.352269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840460+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:07.840460+0000","last_peered":"2024-02-26T12:20:07.840460+0000","last_clean":"2024-02-26T12:20:07.840460+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:07.840460+0000","last_undegraded":"2024-02-26T12:20:07.840460+0000","last_fullsized":"2024-02-26T12:20:07.840460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840823+0000","last_change":"2024-02-26T12:20:06.851695+0000","last_active":"2024-02-26T12:20:07.840823+0000","last_peered":"2024-02-26T12:20:07.840823+0000","last_clean":"2024-02-26T12:20:07.840823+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:07.840823+0000","last_undegraded":"2024-02-26T12:20:07.840823+0000","last_fullsized":"2024-02-26T12:20:07.840823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353626+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:08.353626+0000","last_peered":"2024-02-26T12:20:08.353626+0000","last_clean":"2024-02-26T12:20:08.353626+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:08.353626+0000","last_undegraded":"2024-02-26T12:20:08.353626+0000","last_fullsized":"2024-02-26T12:20:08.353626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353574+0000","last_change":"2024-02-26T12:20:06.852393+0000","last_active":"2024-02-26T12:20:08.353574+0000","last_peered":"2024-02-26T12:20:08.353574+0000","last_clean":"2024-02-26T12:20:08.353574+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:08.353574+0000","last_undegraded":"2024-02-26T12:20:08.353574+0000","last_fullsized":"2024-02-26T12:20:08.353574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840482+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:07.840482+0000","last_peered":"2024-02-26T12:20:07.840482+0000","last_clean":"2024-02-26T12:20:07.840482+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:07.840482+0000","last_undegraded":"2024-02-26T12:20:07.840482+0000","last_fullsized":"2024-02-26T12:20:07.840482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352771+0000","last_change":"2024-02-26T12:20:06.849481+0000","last_active":"2024-02-26T12:20:08.352771+0000","last_peered":"2024-02-26T12:20:08.352771+0000","last_clean":"2024-02-26T12:20:08.352771+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:08.352771+0000","last_undegraded":"2024-02-26T12:20:08.352771+0000","last_fullsized":"2024-02-26T12:20:08.352771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841138+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:07.841138+0000","last_peered":"2024-02-26T12:20:07.841138+0000","last_clean":"2024-02-26T12:20:07.841138+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:07.841138+0000","last_undegraded":"2024-02-26T12:20:07.841138+0000","last_fullsized":"2024-02-26T12:20:07.841138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841041+0000","last_change":"2024-02-26T12:20:06.834421+0000","last_active":"2024-02-26T12:20:07.841041+0000","last_peered":"2024-02-26T12:20:07.841041+0000","last_clean":"2024-02-26T12:20:07.841041+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:07.841041+0000","last_undegraded":"2024-02-26T12:20:07.841041+0000","last_fullsized":"2024-02-26T12:20:07.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352871+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:08.352871+0000","last_peered":"2024-02-26T12:20:08.352871+0000","last_clean":"2024-02-26T12:20:08.352871+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:08.352871+0000","last_undegraded":"2024-02-26T12:20:08.352871+0000","last_fullsized":"2024-02-26T12:20:08.352871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353078+0000","last_change":"2024-02-26T12:20:06.841973+0000","last_active":"2024-02-26T12:20:08.353078+0000","last_peered":"2024-02-26T12:20:08.353078+0000","last_clean":"2024-02-26T12:20:08.353078+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:08.353078+0000","last_undegraded":"2024-02-26T12:20:08.353078+0000","last_fullsized":"2024-02-26T12:20:08.353078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:04:12.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841896+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:07.841896+0000","last_peered":"2024-02-26T12:20:07.841896+0000","last_clean":"2024-02-26T12:20:07.841896+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:07.841896+0000","last_undegraded":"2024-02-26T12:20:07.841896+0000","last_fullsized":"2024-02-26T12:20:07.841896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353613+0000","last_change":"2024-02-26T12:20:06.849714+0000","last_active":"2024-02-26T12:20:08.353613+0000","last_peered":"2024-02-26T12:20:08.353613+0000","last_clean":"2024-02-26T12:20:08.353613+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:08.353613+0000","last_undegraded":"2024-02-26T12:20:08.353613+0000","last_fullsized":"2024-02-26T12:20:08.353613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352543+0000","last_change":"2024-02-26T12:20:06.846095+0000","last_active":"2024-02-26T12:20:08.352543+0000","last_peered":"2024-02-26T12:20:08.352543+0000","last_clean":"2024-02-26T12:20:08.352543+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:08.352543+0000","last_undegraded":"2024-02-26T12:20:08.352543+0000","last_fullsized":"2024-02-26T12:20:08.352543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353073+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:08.353073+0000","last_peered":"2024-02-26T12:20:08.353073+0000","last_clean":"2024-02-26T12:20:08.353073+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:08.353073+0000","last_undegraded":"2024-02-26T12:20:08.353073+0000","last_fullsized":"2024-02-26T12:20:08.353073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:49.632494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352570+0000","last_change":"2024-02-26T12:20:06.844305+0000","last_active":"2024-02-26T12:20:08.352570+0000","last_peered":"2024-02-26T12:20:08.352570+0000","last_clean":"2024-02-26T12:20:08.352570+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:08.352570+0000","last_undegraded":"2024-02-26T12:20:08.352570+0000","last_fullsized":"2024-02-26T12:20:08.352570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:34.562401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841724+0000","last_change":"2024-02-26T12:20:06.836689+0000","last_active":"2024-02-26T12:20:07.841724+0000","last_peered":"2024-02-26T12:20:07.841724+0000","last_clean":"2024-02-26T12:20:07.841724+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:07.841724+0000","last_undegraded":"2024-02-26T12:20:07.841724+0000","last_fullsized":"2024-02-26T12:20:07.841724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352972+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:08.352972+0000","last_peered":"2024-02-26T12:20:08.352972+0000","last_clean":"2024-02-26T12:20:08.352972+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:08.352972+0000","last_undegraded":"2024-02-26T12:20:08.352972+0000","last_fullsized":"2024-02-26T12:20:08.352972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841468+0000","last_change":"2024-02-26T12:20:06.847756+0000","last_active":"2024-02-26T12:20:07.841468+0000","last_peered":"2024-02-26T12:20:07.841468+0000","last_clean":"2024-02-26T12:20:07.841468+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:07.841468+0000","last_undegraded":"2024-02-26T12:20:07.841468+0000","last_fullsized":"2024-02-26T12:20:07.841468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841807+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:07.841807+0000","last_peered":"2024-02-26T12:20:07.841807+0000","last_clean":"2024-02-26T12:20:07.841807+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:07.841807+0000","last_undegraded":"2024-02-26T12:20:07.841807+0000","last_fullsized":"2024-02-26T12:20:07.841807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352439+0000","last_change":"2024-02-26T12:20:06.851971+0000","last_active":"2024-02-26T12:20:08.352439+0000","last_peered":"2024-02-26T12:20:08.352439+0000","last_clean":"2024-02-26T12:20:08.352439+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:08.352439+0000","last_undegraded":"2024-02-26T12:20:08.352439+0000","last_fullsized":"2024-02-26T12:20:08.352439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841761+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:07.841761+0000","last_peered":"2024-02-26T12:20:07.841761+0000","last_clean":"2024-02-26T12:20:07.841761+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:07.841761+0000","last_undegraded":"2024-02-26T12:20:07.841761+0000","last_fullsized":"2024-02-26T12:20:07.841761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352170+0000","last_change":"2024-02-26T12:20:06.841194+0000","last_active":"2024-02-26T12:20:08.352170+0000","last_peered":"2024-02-26T12:20:08.352170+0000","last_clean":"2024-02-26T12:20:08.352170+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:08.352170+0000","last_undegraded":"2024-02-26T12:20:08.352170+0000","last_fullsized":"2024-02-26T12:20:08.352170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:36.378565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842034+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:07.842034+0000","last_peered":"2024-02-26T12:20:07.842034+0000","last_clean":"2024-02-26T12:20:07.842034+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:07.842034+0000","last_undegraded":"2024-02-26T12:20:07.842034+0000","last_fullsized":"2024-02-26T12:20:07.842034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.841086+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:45.667456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840347+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:07.840347+0000","last_peered":"2024-02-26T12:20:07.840347+0000","last_clean":"2024-02-26T12:20:07.840347+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:07.840347+0000","last_undegraded":"2024-02-26T12:20:07.840347+0000","last_fullsized":"2024-02-26T12:20:07.840347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352358+0000","last_change":"2024-02-26T12:20:06.847035+0000","last_active":"2024-02-26T12:20:08.352358+0000","last_peered":"2024-02-26T12:20:08.352358+0000","last_clean":"2024-02-26T12:20:08.352358+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:08.352358+0000","last_undegraded":"2024-02-26T12:20:08.352358+0000","last_fullsized":"2024-02-26T12:20:08.352358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:44.444191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352952+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:08.352952+0000","last_peered":"2024-02-26T12:20:08.352952+0000","last_clean":"2024-02-26T12:20:08.352952+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:08.352952+0000","last_undegraded":"2024-02-26T12:20:08.352952+0000","last_fullsized":"2024-02-26T12:20:08.352952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.351951+0000","last_change":"2024-02-26T12:20:06.836131+0000","last_active":"2024-02-26T12:20:08.351951+0000","last_peered":"2024-02-26T12:20:08.351951+0000","last_clean":"2024-02-26T12:20:08.351951+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:08.351951+0000","last_undegraded":"2024-02-26T12:20:08.351951+0000","last_fullsized":"2024-02-26T12:20:08.351951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:37.734794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841367+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:07.841367+0000","last_peered":"2024-02-26T12:20:07.841367+0000","last_clean":"2024-02-26T12:20:07.841367+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:07.841367+0000","last_undegraded":"2024-02-26T12:20:07.841367+0000","last_fullsized":"2024-02-26T12:20:07.841367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352683+0000","last_change":"2024-02-26T12:20:06.843136+0000","last_active":"2024-02-26T12:20:08.352683+0000","last_peered":"2024-02-26T12:20:08.352683+0000","last_clean":"2024-02-26T12:20:08.352683+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:08.352683+0000","last_undegraded":"2024-02-26T12:20:08.352683+0000","last_fullsized":"2024-02-26T12:20:08.352683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840292+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:07.840292+0000","last_peered":"2024-02-26T12:20:07.840292+0000","last_clean":"2024-02-26T12:20:07.840292+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:07.840292+0000","last_undegraded":"2024-02-26T12:20:07.840292+0000","last_fullsized":"2024-02-26T12:20:07.840292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.843988+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:15.222912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353068+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:08.353068+0000","last_peered":"2024-02-26T12:20:08.353068+0000","last_clean":"2024-02-26T12:20:08.353068+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:08.353068+0000","last_undegraded":"2024-02-26T12:20:08.353068+0000","last_fullsized":"2024-02-26T12:20:08.353068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841445+0000","last_change":"2024-02-26T12:20:06.846498+0000","last_active":"2024-02-26T12:20:07.841445+0000","last_peered":"2024-02-26T12:20:07.841445+0000","last_clean":"2024-02-26T12:20:07.841445+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:07.841445+0000","last_undegraded":"2024-02-26T12:20:07.841445+0000","last_fullsized":"2024-02-26T12:20:07.841445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840598+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:07.840598+0000","last_peered":"2024-02-26T12:20:07.840598+0000","last_clean":"2024-02-26T12:20:07.840598+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:07.840598+0000","last_undegraded":"2024-02-26T12:20:07.840598+0000","last_fullsized":"2024-02-26T12:20:07.840598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840309+0000","last_change":"2024-02-26T12:20:06.840249+0000","last_active":"2024-02-26T12:20:07.840309+0000","last_peered":"2024-02-26T12:20:07.840309+0000","last_clean":"2024-02-26T12:20:07.840309+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:07.840309+0000","last_undegraded":"2024-02-26T12:20:07.840309+0000","last_fullsized":"2024-02-26T12:20:07.840309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352525+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:08.352525+0000","last_peered":"2024-02-26T12:20:08.352525+0000","last_clean":"2024-02-26T12:20:08.352525+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:08.352525+0000","last_undegraded":"2024-02-26T12:20:08.352525+0000","last_fullsized":"2024-02-26T12:20:08.352525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352648+0000","last_change":"2024-02-26T12:20:06.844149+0000","last_active":"2024-02-26T12:20:08.352648+0000","last_peered":"2024-02-26T12:20:08.352648+0000","last_clean":"2024-02-26T12:20:08.352648+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:08.352648+0000","last_undegraded":"2024-02-26T12:20:08.352648+0000","last_fullsized":"2024-02-26T12:20:08.352648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840470+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:07.840470+0000","last_peered":"2024-02-26T12:20:07.840470+0000","last_clean":"2024-02-26T12:20:07.840470+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:07.840470+0000","last_undegraded":"2024-02-26T12:20:07.840470+0000","last_fullsized":"2024-02-26T12:20:07.840470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840357+0000","last_change":"2024-02-26T12:20:06.846886+0000","last_active":"2024-02-26T12:20:07.840357+0000","last_peered":"2024-02-26T12:20:07.840357+0000","last_clean":"2024-02-26T12:20:07.840357+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:07.840357+0000","last_undegraded":"2024-02-26T12:20:07.840357+0000","last_fullsized":"2024-02-26T12:20:07.840357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353099+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:08.353099+0000","last_peered":"2024-02-26T12:20:08.353099+0000","last_clean":"2024-02-26T12:20:08.353099+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:08.353099+0000","last_undegraded":"2024-02-26T12:20:08.353099+0000","last_fullsized":"2024-02-26T12:20:08.353099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352712+0000","last_change":"2024-02-26T12:20:06.849839+0000","last_active":"2024-02-26T12:20:08.352712+0000","last_peered":"2024-02-26T12:20:08.352712+0000","last_clean":"2024-02-26T12:20:08.352712+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:08.352712+0000","last_undegraded":"2024-02-26T12:20:08.352712+0000","last_fullsized":"2024-02-26T12:20:08.352712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841436+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:07.841436+0000","last_peered":"2024-02-26T12:20:07.841436+0000","last_clean":"2024-02-26T12:20:07.841436+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:07.841436+0000","last_undegraded":"2024-02-26T12:20:07.841436+0000","last_fullsized":"2024-02-26T12:20:07.841436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840423+0000","last_change":"2024-02-26T12:20:06.849696+0000","last_active":"2024-02-26T12:20:07.840423+0000","last_peered":"2024-02-26T12:20:07.840423+0000","last_clean":"2024-02-26T12:20:07.840423+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:07.840423+0000","last_undegraded":"2024-02-26T12:20:07.840423+0000","last_fullsized":"2024-02-26T12:20:07.840423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352941+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:08.352941+0000","last_peered":"2024-02-26T12:20:08.352941+0000","last_clean":"2024-02-26T12:20:08.352941+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:08.352941+0000","last_undegraded":"2024-02-26T12:20:08.352941+0000","last_fullsized":"2024-02-26T12:20:08.352941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352828+0000","last_change":"2024-02-26T12:20:06.839596+0000","last_active":"2024-02-26T12:20:08.352828+0000","last_peered":"2024-02-26T12:20:08.352828+0000","last_clean":"2024-02-26T12:20:08.352828+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:08.352828+0000","last_undegraded":"2024-02-26T12:20:08.352828+0000","last_fullsized":"2024-02-26T12:20:08.352828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352875+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:08.352875+0000","last_peered":"2024-02-26T12:20:08.352875+0000","last_clean":"2024-02-26T12:20:08.352875+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:08.352875+0000","last_undegraded":"2024-02-26T12:20:08.352875+0000","last_fullsized":"2024-02-26T12:20:08.352875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352681+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:08.352681+0000","last_peered":"2024-02-26T12:20:08.352681+0000","last_clean":"2024-02-26T12:20:08.352681+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:08.352681+0000","last_undegraded":"2024-02-26T12:20:08.352681+0000","last_fullsized":"2024-02-26T12:20:08.352681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:22.410 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-26T12:20:22.410 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.562+0000 7f52aadb4640 1 Processor -- start 2024-02-26T12:20:22.548 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.562+0000 7f52aadb4640 1 -- start start 2024-02-26T12:20:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52aadb4640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52a415def0 0x7f52a40b9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.550 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52aadb4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40d1f50 con 0x7f52a40ce8b0 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52aadb4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40d2230 con 0x7f52a40b2d80 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52aadb4640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40d2510 con 0x7f52a415def0 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52a8b50640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f52a415def0 0x7f52a40b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52a9351640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f52a40ce8b0 0x7f52a40b6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44962/0 (socket says 172.21.15.113:44962) 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.563+0000 7f52a9351640 1 -- 172.21.15.113:0/535775819 learned_addr learned my addr 172.21.15.113:0/535775819 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a8b50640 1 -- 172.21.15.113:0/535775819 >> v1:172.21.15.152:6789/0 conn(0x7f52a40b2d80 legacy=0x7f52a40d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.551 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a8b50640 1 -- 172.21.15.113:0/535775819 >> v1:172.21.15.113:6789/0 conn(0x7f52a40ce8b0 legacy=0x7f52a40b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a8b50640 1 -- 172.21.15.113:0/535775819 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40d27f0 con 0x7f52a415def0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a37fe640 1 -- 172.21.15.113:0/535775819 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125682780 0 0) 0x7f52a40d1f50 con 0x7f52a40ce8b0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a8b50640 1 --2- 172.21.15.113:0/535775819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a415def0 0x7f52a40b9400 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f52940097d0 tx=0x7f529402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed896c627c3381c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a37fe640 1 -- 172.21.15.113:0/535775819 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294034070 con 0x7f52a415def0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a37fe640 1 -- 172.21.15.113:0/535775819 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294030610 con 0x7f52a415def0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.564+0000 7f52a37fe640 1 -- 172.21.15.113:0/535775819 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940309e0 con 0x7f52a415def0 2024-02-26T12:20:22.552 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 -- 172.21.15.113:0/535775819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a415def0 msgr2=0x7f52a40b9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 --2- 172.21.15.113:0/535775819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a415def0 0x7f52a40b9400 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f52940097d0 tx=0x7f529402b960 comp rx=0 tx=0).stop 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 -- 172.21.15.113:0/535775819 shutdown_connections 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 --2- 172.21.15.113:0/535775819 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a415def0 0x7f52a40b9400 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 -- 172.21.15.113:0/535775819 >> 172.21.15.113:0/535775819 conn(0x7f52a40728b0 msgr2=0x7f52a40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 -- 172.21.15.113:0/535775819 shutdown_connections 2024-02-26T12:20:22.553 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.565+0000 7f52aadb4640 1 -- 172.21.15.113:0/535775819 wait complete. 2024-02-26T12:20:22.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.566+0000 7f52aadb4640 1 Processor -- start 2024-02-26T12:20:22.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.566+0000 7f52aadb4640 1 -- start start 2024-02-26T12:20:22.556 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52a40b2d80 0x7f52a40cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a40ce8b0 0x7f52a4158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40b9940 con 0x7f52a40cade0 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40d3700 con 0x7f52a40ce8b0 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52aadb4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40b9ac0 con 0x7f52a40b2d80 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.557 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43872/0 (socket says 172.21.15.113:43872) 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 -- 172.21.15.113:0/2256072348 learned_addr learned my addr 172.21.15.113:0/2256072348 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a3fff640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a40ce8b0 0x7f52a4158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a8b50640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52a40b2d80 0x7f52a40cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 -- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52a40b2d80 msgr2=0x7f52a40cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52a40b2d80 0x7f52a40cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 -- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a40ce8b0 msgr2=0x7f52a4158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a40ce8b0 0x7f52a4158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.558 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.567+0000 7f52a9351640 1 -- 172.21.15.113:0/2256072348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40cb670 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52a9351640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7a0 tx=0x7f529c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c018070 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00a640 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a40cb950 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00aa70 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.568+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40cbf10 con 0x7f52a40cade0 2024-02-26T12:20:22.559 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.569+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4074a50 con 0x7f52a40cade0 2024-02-26T12:20:22.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.569+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f529c01b070 con 0x7f52a40cade0 2024-02-26T12:20:22.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.570+0000 7f52a17fa640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 0x7f529006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.570+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f529c089810 con 0x7f52a40cade0 2024-02-26T12:20:22.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.570+0000 7f52a8b50640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 0x7f529006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.560 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.570+0000 7f52a8b50640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 0x7f529006d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5294036000 tx=0x7f5294008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.561 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.574+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f529c058690 con 0x7f52a40cade0 2024-02-26T12:20:22.727 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.742+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52a40008d0 con 0x7f529006b4d0 2024-02-26T12:20:22.733 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.748+0000 7f52a17fa640 1 -- 172.21.15.113:0/2256072348 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251840 (secure 0 0 0) 0x7f52a40008d0 con 0x7f529006b4d0 2024-02-26T12:20:22.736 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:22.737 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:22.738 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 msgr2=0x7f529006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 0x7f529006d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5294036000 tx=0x7f5294008030 comp rx=0 tx=0).stop 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 msgr2=0x7f52a40aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f529c00c7a0 tx=0x7f529c00cc60 comp rx=0 tx=0).stop 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 shutdown_connections 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f529006b4d0 0x7f529006d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.739 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f52a40cade0 0x7f52a40aa420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a40ce8b0 0x7f52a4158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 --2- 172.21.15.113:0/2256072348 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52a40b2d80 0x7f52a40cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 >> 172.21.15.113:0/2256072348 conn(0x7f52a40728b0 msgr2=0x7f52a40b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 shutdown_connections 2024-02-26T12:20:22.740 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.751+0000 7f52aadb4640 1 -- 172.21.15.113:0/2256072348 wait complete. 2024-02-26T12:20:22.747 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-02-26T12:20:21.168508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220108,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754612,"statfs":{"total":773094113280,"available":772868722688,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003537"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352976+0000","last_change":"2024-02-26T12:20:06.844968+0000","last_active":"2024-02-26T12:20:08.352976+0000","last_peered":"2024-02-26T12:20:08.352976+0000","last_clean":"2024-02-26T12:20:08.352976+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:08.352976+0000","last_undegraded":"2024-02-26T12:20:08.352976+0000","last_fullsized":"2024-02-26T12:20:08.352976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:50.636359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353304+0000","last_change":"2024-02-26T12:20:06.849184+0000","last_active":"2024-02-26T12:20:08.353304+0000","last_peered":"2024-02-26T12:20:08.353304+0000","last_clean":"2024-02-26T12:20:08.353304+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:08.353304+0000","last_undegraded":"2024-02-26T12:20:08.353304+0000","last_fullsized":"2024-02-26T12:20:08.353304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841079+0000","last_change":"2024-02-26T12:20:06.834964+0000","last_active":"2024-02-26T12:20:07.841079+0000","last_peered":"2024-02-26T12:20:07.841079+0000","last_clean":"2024-02-26T12:20:07.841079+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:07.841079+0000","last_undegraded":"2024-02-26T12:20:07.841079+0000","last_fullsized":"2024-02-26T12:20:07.841079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352362+0000","last_change":"2024-02-26T12:20:06.852832+0000","last_active":"2024-02-26T12:20:08.352362+0000","last_peered":"2024-02-26T12:20:08.352362+0000","last_clean":"2024-02-26T12:20:08.352362+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:08.352362+0000","last_undegraded":"2024-02-26T12:20:08.352362+0000","last_fullsized":"2024-02-26T12:20:08.352362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352062+0000","last_change":"2024-02-26T12:20:06.852324+0000","last_active":"2024-02-26T12:20:08.352062+0000","last_peered":"2024-02-26T12:20:08.352062+0000","last_clean":"2024-02-26T12:20:08.352062+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:08.352062+0000","last_undegraded":"2024-02-26T12:20:08.352062+0000","last_fullsized":"2024-02-26T12:20:08.352062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:54.685782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352961+0000","last_change":"2024-02-26T12:20:06.849421+0000","last_active":"2024-02-26T12:20:08.352961+0000","last_peered":"2024-02-26T12:20:08.352961+0000","last_clean":"2024-02-26T12:20:08.352961+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:08.352961+0000","last_undegraded":"2024-02-26T12:20:08.352961+0000","last_fullsized":"2024-02-26T12:20:08.352961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353217+0000","last_change":"2024-02-26T12:20:06.843366+0000","last_active":"2024-02-26T12:20:08.353217+0000","last_peered":"2024-02-26T12:20:08.353217+0000","last_clean":"2024-02-26T12:20:08.353217+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:08.353217+0000","last_undegraded":"2024-02-26T12:20:08.353217+0000","last_fullsized":"2024-02-26T12:20:08.353217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:25.589137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352342+0000","last_change":"2024-02-26T12:20:06.839766+0000","last_active":"2024-02-26T12:20:08.352342+0000","last_peered":"2024-02-26T12:20:08.352342+0000","last_clean":"2024-02-26T12:20:08.352342+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:08.352342+0000","last_undegraded":"2024-02-26T12:20:08.352342+0000","last_fullsized":"2024-02-26T12:20:08.352342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841973+0000","last_change":"2024-02-26T12:20:06.848927+0000","last_active":"2024-02-26T12:20:07.841973+0000","last_peered":"2024-02-26T12:20:07.841973+0000","last_clean":"2024-02-26T12:20:07.841973+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:07.841973+0000","last_undegraded":"2024-02-26T12:20:07.841973+0000","last_fullsized":"2024-02-26T12:20:07.841973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352274+0000","last_change":"2024-02-26T12:20:06.850295+0000","last_active":"2024-02-26T12:20:08.352274+0000","last_peered":"2024-02-26T12:20:08.352274+0000","last_clean":"2024-02-26T12:20:08.352274+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:08.352274+0000","last_undegraded":"2024-02-26T12:20:08.352274+0000","last_fullsized":"2024-02-26T12:20:08.352274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353066+0000","last_change":"2024-02-26T12:20:06.846792+0000","last_active":"2024-02-26T12:20:08.353066+0000","last_peered":"2024-02-26T12:20:08.353066+0000","last_clean":"2024-02-26T12:20:08.353066+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:08.353066+0000","last_undegraded":"2024-02-26T12:20:08.353066+0000","last_fullsized":"2024-02-26T12:20:08.353066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840815+0000","last_change":"2024-02-26T12:20:06.850771+0000","last_active":"2024-02-26T12:20:07.840815+0000","last_peered":"2024-02-26T12:20:07.840815+0000","last_clean":"2024-02-26T12:20:07.840815+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:07.840815+0000","last_undegraded":"2024-02-26T12:20:07.840815+0000","last_fullsized":"2024-02-26T12:20:07.840815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352210+0000","last_change":"2024-02-26T12:20:06.845105+0000","last_active":"2024-02-26T12:20:08.352210+0000","last_peered":"2024-02-26T12:20:08.352210+0000","last_clean":"2024-02-26T12:20:08.352210+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:08.352210+0000","last_undegraded":"2024-02-26T12:20:08.352210+0000","last_fullsized":"2024-02-26T12:20:08.352210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:37.707892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353101+0000","last_change":"2024-02-26T12:20:06.849132+0000","last_active":"2024-02-26T12:20:08.353101+0000","last_peered":"2024-02-26T12:20:08.353101+0000","last_clean":"2024-02-26T12:20:08.353101+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:08.353101+0000","last_undegraded":"2024-02-26T12:20:08.353101+0000","last_fullsized":"2024-02-26T12:20:08.353101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840492+0000","last_change":"2024-02-26T12:20:06.843678+0000","last_active":"2024-02-26T12:20:07.840492+0000","last_peered":"2024-02-26T12:20:07.840492+0000","last_clean":"2024-02-26T12:20:07.840492+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:07.840492+0000","last_undegraded":"2024-02-26T12:20:07.840492+0000","last_fullsized":"2024-02-26T12:20:07.840492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352649+0000","last_change":"2024-02-26T12:20:06.850419+0000","last_active":"2024-02-26T12:20:08.352649+0000","last_peered":"2024-02-26T12:20:08.352649+0000","last_clean":"2024-02-26T12:20:08.352649+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:08.352649+0000","last_undegraded":"2024-02-26T12:20:08.352649+0000","last_fullsized":"2024-02-26T12:20:08.352649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353213+0000","last_change":"2024-02-26T12:20:06.846044+0000","last_active":"2024-02-26T12:20:08.353213+0000","last_peered":"2024-02-26T12:20:08.353213+0000","last_clean":"2024-02-26T12:20:08.353213+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:08.353213+0000","last_undegraded":"2024-02-26T12:20:08.353213+0000","last_fullsized":"2024-02-26T12:20:08.353213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353380+0000","last_change":"2024-02-26T12:20:06.849063+0000","last_active":"2024-02-26T12:20:08.353380+0000","last_peered":"2024-02-26T12:20:08.353380+0000","last_clean":"2024-02-26T12:20:08.353380+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:08.353380+0000","last_undegraded":"2024-02-26T12:20:08.353380+0000","last_fullsized":"2024-02-26T12:20:08.353380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353255+0000","last_change":"2024-02-26T12:20:06.854247+0000","last_active":"2024-02-26T12:20:08.353255+0000","last_peered":"2024-02-26T12:20:08.353255+0000","last_clean":"2024-02-26T12:20:08.353255+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:08.353255+0000","last_undegraded":"2024-02-26T12:20:08.353255+0000","last_fullsized":"2024-02-26T12:20:08.353255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352391+0000","last_change":"2024-02-26T12:20:06.847720+0000","last_active":"2024-02-26T12:20:08.352391+0000","last_peered":"2024-02-26T12:20:08.352391+0000","last_clean":"2024-02-26T12:20:08.352391+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:08.352391+0000","last_undegraded":"2024-02-26T12:20:08.352391+0000","last_fullsized":"2024-02-26T12:20:08.352391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:36.567582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841645+0000","last_change":"2024-02-26T12:20:06.835429+0000","last_active":"2024-02-26T12:20:07.841645+0000","last_peered":"2024-02-26T12:20:07.841645+0000","last_clean":"2024-02-26T12:20:07.841645+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:07.841645+0000","last_undegraded":"2024-02-26T12:20:07.841645+0000","last_fullsized":"2024-02-26T12:20:07.841645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:37.928321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841332+0000","last_change":"2024-02-26T12:20:06.849789+0000","last_active":"2024-02-26T12:20:07.841332+0000","last_peered":"2024-02-26T12:20:07.841332+0000","last_clean":"2024-02-26T12:20:07.841332+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:07.841332+0000","last_undegraded":"2024-02-26T12:20:07.841332+0000","last_fullsized":"2024-02-26T12:20:07.841332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:24.470080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840193+0000","last_change":"2024-02-26T12:20:06.840392+0000","last_active":"2024-02-26T12:20:07.840193+0000","last_peered":"2024-02-26T12:20:07.840193+0000","last_clean":"2024-02-26T12:20:07.840193+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:07.840193+0000","last_undegraded":"2024-02-26T12:20:07.840193+0000","last_fullsized":"2024-02-26T12:20:07.840193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:19.601355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840620+0000","last_change":"2024-02-26T12:20:06.838075+0000","last_active":"2024-02-26T12:20:07.840620+0000","last_peered":"2024-02-26T12:20:07.840620+0000","last_clean":"2024-02-26T12:20:07.840620+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:07.840620+0000","last_undegraded":"2024-02-26T12:20:07.840620+0000","last_fullsized":"2024-02-26T12:20:07.840620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352811+0000","last_change":"2024-02-26T12:20:06.844929+0000","last_active":"2024-02-26T12:20:08.352811+0000","last_peered":"2024-02-26T12:20:08.352811+0000","last_clean":"2024-02-26T12:20:08.352811+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:08.352811+0000","last_undegraded":"2024-02-26T12:20:08.352811+0000","last_fullsized":"2024-02-26T12:20:08.352811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:49:40.985045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353454+0000","last_change":"2024-02-26T12:20:06.848784+0000","last_active":"2024-02-26T12:20:08.353454+0000","last_peered":"2024-02-26T12:20:08.353454+0000","last_clean":"2024-02-26T12:20:08.353454+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:08.353454+0000","last_undegraded":"2024-02-26T12:20:08.353454+0000","last_fullsized":"2024-02-26T12:20:08.353454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:06.852296+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:28:41.455138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840972+0000","last_change":"2024-02-26T12:20:06.834398+0000","last_active":"2024-02-26T12:20:07.840972+0000","last_peered":"2024-02-26T12:20:07.840972+0000","last_clean":"2024-02-26T12:20:07.840972+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:07.840972+0000","last_undegraded":"2024-02-26T12:20:07.840972+0000","last_fullsized":"2024-02-26T12:20:07.840972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841814+0000","last_change":"2024-02-26T12:20:06.851836+0000","last_active":"2024-02-26T12:20:07.841814+0000","last_peered":"2024-02-26T12:20:07.841814+0000","last_clean":"2024-02-26T12:20:07.841814+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:07.841814+0000","last_undegraded":"2024-02-26T12:20:07.841814+0000","last_fullsized":"2024-02-26T12:20:07.841814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352646+0000","last_change":"2024-02-26T12:20:06.840747+0000","last_active":"2024-02-26T12:20:08.352646+0000","last_peered":"2024-02-26T12:20:08.352646+0000","last_clean":"2024-02-26T12:20:08.352646+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:08.352646+0000","last_undegraded":"2024-02-26T12:20:08.352646+0000","last_fullsized":"2024-02-26T12:20:08.352646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352534+0000","last_change":"2024-02-26T12:20:06.848793+0000","last_active":"2024-02-26T12:20:08.352534+0000","last_peered":"2024-02-26T12:20:08.352534+0000","last_clean":"2024-02-26T12:20:08.352534+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:08.352534+0000","last_undegraded":"2024-02-26T12:20:08.352534+0000","last_fullsized":"2024-02-26T12:20:08.352534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352385+0000","last_change":"2024-02-26T12:20:06.846528+0000","last_active":"2024-02-26T12:20:08.352385+0000","last_peered":"2024-02-26T12:20:08.352385+0000","last_clean":"2024-02-26T12:20:08.352385+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:08.352385+0000","last_undegraded":"2024-02-26T12:20:08.352385+0000","last_fullsized":"2024-02-26T12:20:08.352385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840475+0000","last_change":"2024-02-26T12:20:06.839103+0000","last_active":"2024-02-26T12:20:07.840475+0000","last_peered":"2024-02-26T12:20:07.840475+0000","last_clean":"2024-02-26T12:20:07.840475+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:07.840475+0000","last_undegraded":"2024-02-26T12:20:07.840475+0000","last_fullsized":"2024-02-26T12:20:07.840475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353090+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:08.353090+0000","last_peered":"2024-02-26T12:20:08.353090+0000","last_clean":"2024-02-26T12:20:08.353090+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:08.353090+0000","last_undegraded":"2024-02-26T12:20:08.353090+0000","last_fullsized":"2024-02-26T12:20:08.353090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353108+0000","last_change":"2024-02-26T12:20:06.844293+0000","last_active":"2024-02-26T12:20:08.353108+0000","last_peered":"2024-02-26T12:20:08.353108+0000","last_clean":"2024-02-26T12:20:08.353108+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:08.353108+0000","last_undegraded":"2024-02-26T12:20:08.353108+0000","last_fullsized":"2024-02-26T12:20:08.353108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840380+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:07.840380+0000","last_peered":"2024-02-26T12:20:07.840380+0000","last_clean":"2024-02-26T12:20:07.840380+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:07.840380+0000","last_undegraded":"2024-02-26T12:20:07.840380+0000","last_fullsized":"2024-02-26T12:20:07.840380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842032+0000","last_change":"2024-02-26T12:20:06.851045+0000","last_active":"2024-02-26T12:20:07.842032+0000","last_peered":"2024-02-26T12:20:07.842032+0000","last_clean":"2024-02-26T12:20:07.842032+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:07.842032+0000","last_undegraded":"2024-02-26T12:20:07.842032+0000","last_fullsized":"2024-02-26T12:20:07.842032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353347+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:08.353347+0000","last_peered":"2024-02-26T12:20:08.353347+0000","last_clean":"2024-02-26T12:20:08.353347+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:08.353347+0000","last_undegraded":"2024-02-26T12:20:08.353347+0000","last_fullsized":"2024-02-26T12:20:08.353347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352989+0000","last_change":"2024-02-26T12:20:06.839258+0000","last_active":"2024-02-26T12:20:08.352989+0000","last_peered":"2024-02-26T12:20:08.352989+0000","last_clean":"2024-02-26T12:20:08.352989+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:08.352989+0000","last_undegraded":"2024-02-26T12:20:08.352989+0000","last_fullsized":"2024-02-26T12:20:08.352989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:11.744361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352472+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:08.352472+0000","last_peered":"2024-02-26T12:20:08.352472+0000","last_clean":"2024-02-26T12:20:08.352472+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:08.352472+0000","last_undegraded":"2024-02-26T12:20:08.352472+0000","last_fullsized":"2024-02-26T12:20:08.352472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:38:38.644589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:06.846106+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841764+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:07.841764+0000","last_peered":"2024-02-26T12:20:07.841764+0000","last_clean":"2024-02-26T12:20:07.841764+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:07.841764+0000","last_undegraded":"2024-02-26T12:20:07.841764+0000","last_fullsized":"2024-02-26T12:20:07.841764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840887+0000","last_change":"2024-02-26T12:20:06.835746+0000","last_active":"2024-02-26T12:20:07.840887+0000","last_peered":"2024-02-26T12:20:07.840887+0000","last_clean":"2024-02-26T12:20:07.840887+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:07.840887+0000","last_undegraded":"2024-02-26T12:20:07.840887+0000","last_fullsized":"2024-02-26T12:20:07.840887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841583+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:07.841583+0000","last_peered":"2024-02-26T12:20:07.841583+0000","last_clean":"2024-02-26T12:20:07.841583+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:07.841583+0000","last_undegraded":"2024-02-26T12:20:07.841583+0000","last_fullsized":"2024-02-26T12:20:07.841583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840817+0000","last_change":"2024-02-26T12:20:06.840340+0000","last_active":"2024-02-26T12:20:07.840817+0000","last_peered":"2024-02-26T12:20:07.840817+0000","last_clean":"2024-02-26T12:20:07.840817+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:07.840817+0000","last_undegraded":"2024-02-26T12:20:07.840817+0000","last_fullsized":"2024-02-26T12:20:07.840817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:55.795288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353065+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:08.353065+0000","last_peered":"2024-02-26T12:20:08.353065+0000","last_clean":"2024-02-26T12:20:08.353065+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:08.353065+0000","last_undegraded":"2024-02-26T12:20:08.353065+0000","last_fullsized":"2024-02-26T12:20:08.353065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:11.880880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352269+0000","last_change":"2024-02-26T12:20:06.838655+0000","last_active":"2024-02-26T12:20:08.352269+0000","last_peered":"2024-02-26T12:20:08.352269+0000","last_clean":"2024-02-26T12:20:08.352269+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:08.352269+0000","last_undegraded":"2024-02-26T12:20:08.352269+0000","last_fullsized":"2024-02-26T12:20:08.352269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840460+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:07.840460+0000","last_peered":"2024-02-26T12:20:07.840460+0000","last_clean":"2024-02-26T12:20:07.840460+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:07.840460+0000","last_undegraded":"2024-02-26T12:20:07.840460+0000","last_fullsized":"2024-02-26T12:20:07.840460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840823+0000","last_change":"2024-02-26T12:20:06.851695+0000","last_active":"2024-02-26T12:20:07.840823+0000","last_peered":"2024-02-26T12:20:07.840823+0000","last_clean":"2024-02-26T12:20:07.840823+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:07.840823+0000","last_undegraded":"2024-02-26T12:20:07.840823+0000","last_fullsized":"2024-02-26T12:20:07.840823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353626+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:08.353626+0000","last_peered":"2024-02-26T12:20:08.353626+0000","last_clean":"2024-02-26T12:20:08.353626+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:08.353626+0000","last_undegraded":"2024-02-26T12:20:08.353626+0000","last_fullsized":"2024-02-26T12:20:08.353626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:54.791424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353574+0000","last_change":"2024-02-26T12:20:06.852393+0000","last_active":"2024-02-26T12:20:08.353574+0000","last_peered":"2024-02-26T12:20:08.353574+0000","last_clean":"2024-02-26T12:20:08.353574+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:08.353574+0000","last_undegraded":"2024-02-26T12:20:08.353574+0000","last_fullsized":"2024-02-26T12:20:08.353574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840482+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:07.840482+0000","last_peered":"2024-02-26T12:20:07.840482+0000","last_clean":"2024-02-26T12:20:07.840482+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:07.840482+0000","last_undegraded":"2024-02-26T12:20:07.840482+0000","last_fullsized":"2024-02-26T12:20:07.840482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352771+0000","last_change":"2024-02-26T12:20:06.849481+0000","last_active":"2024-02-26T12:20:08.352771+0000","last_peered":"2024-02-26T12:20:08.352771+0000","last_clean":"2024-02-26T12:20:08.352771+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:08.352771+0000","last_undegraded":"2024-02-26T12:20:08.352771+0000","last_fullsized":"2024-02-26T12:20:08.352771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841138+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:07.841138+0000","last_peered":"2024-02-26T12:20:07.841138+0000","last_clean":"2024-02-26T12:20:07.841138+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:07.841138+0000","last_undegraded":"2024-02-26T12:20:07.841138+0000","last_fullsized":"2024-02-26T12:20:07.841138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841041+0000","last_change":"2024-02-26T12:20:06.834421+0000","last_active":"2024-02-26T12:20:07.841041+0000","last_peered":"2024-02-26T12:20:07.841041+0000","last_clean":"2024-02-26T12:20:07.841041+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:07.841041+0000","last_undegraded":"2024-02-26T12:20:07.841041+0000","last_fullsized":"2024-02-26T12:20:07.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352871+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:08.352871+0000","last_peered":"2024-02-26T12:20:08.352871+0000","last_clean":"2024-02-26T12:20:08.352871+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:08.352871+0000","last_undegraded":"2024-02-26T12:20:08.352871+0000","last_fullsized":"2024-02-26T12:20:08.352871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353078+0000","last_change":"2024-02-26T12:20:06.841973+0000","last_active":"2024-02-26T12:20:08.353078+0000","last_peered":"2024-02-26T12:20:08.353078+0000","last_clean":"2024-02-26T12:20:08.353078+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:08.353078+0000","last_undegraded":"2024-02-26T12:20:08.353078+0000","last_fullsized":"2024-02-26T12:20:08.353078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:04:12.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841896+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:07.841896+0000","last_peered":"2024-02-26T12:20:07.841896+0000","last_clean":"2024-02-26T12:20:07.841896+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:07.841896+0000","last_undegraded":"2024-02-26T12:20:07.841896+0000","last_fullsized":"2024-02-26T12:20:07.841896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353613+0000","last_change":"2024-02-26T12:20:06.849714+0000","last_active":"2024-02-26T12:20:08.353613+0000","last_peered":"2024-02-26T12:20:08.353613+0000","last_clean":"2024-02-26T12:20:08.353613+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:08.353613+0000","last_undegraded":"2024-02-26T12:20:08.353613+0000","last_fullsized":"2024-02-26T12:20:08.353613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:58:50.798821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352543+0000","last_change":"2024-02-26T12:20:06.846095+0000","last_active":"2024-02-26T12:20:08.352543+0000","last_peered":"2024-02-26T12:20:08.352543+0000","last_clean":"2024-02-26T12:20:08.352543+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:08.352543+0000","last_undegraded":"2024-02-26T12:20:08.352543+0000","last_fullsized":"2024-02-26T12:20:08.352543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353073+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:08.353073+0000","last_peered":"2024-02-26T12:20:08.353073+0000","last_clean":"2024-02-26T12:20:08.353073+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:08.353073+0000","last_undegraded":"2024-02-26T12:20:08.353073+0000","last_fullsized":"2024-02-26T12:20:08.353073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:49.632494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352570+0000","last_change":"2024-02-26T12:20:06.844305+0000","last_active":"2024-02-26T12:20:08.352570+0000","last_peered":"2024-02-26T12:20:08.352570+0000","last_clean":"2024-02-26T12:20:08.352570+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:08.352570+0000","last_undegraded":"2024-02-26T12:20:08.352570+0000","last_fullsized":"2024-02-26T12:20:08.352570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352832+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:08.352832+0000","last_peered":"2024-02-26T12:20:08.352832+0000","last_clean":"2024-02-26T12:20:08.352832+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:08.352832+0000","last_undegraded":"2024-02-26T12:20:08.352832+0000","last_fullsized":"2024-02-26T12:20:08.352832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:34.562401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841724+0000","last_change":"2024-02-26T12:20:06.836689+0000","last_active":"2024-02-26T12:20:07.841724+0000","last_peered":"2024-02-26T12:20:07.841724+0000","last_clean":"2024-02-26T12:20:07.841724+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:07.841724+0000","last_undegraded":"2024-02-26T12:20:07.841724+0000","last_fullsized":"2024-02-26T12:20:07.841724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352972+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:08.352972+0000","last_peered":"2024-02-26T12:20:08.352972+0000","last_clean":"2024-02-26T12:20:08.352972+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:08.352972+0000","last_undegraded":"2024-02-26T12:20:08.352972+0000","last_fullsized":"2024-02-26T12:20:08.352972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:45:03.972804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841468+0000","last_change":"2024-02-26T12:20:06.847756+0000","last_active":"2024-02-26T12:20:07.841468+0000","last_peered":"2024-02-26T12:20:07.841468+0000","last_clean":"2024-02-26T12:20:07.841468+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:07.841468+0000","last_undegraded":"2024-02-26T12:20:07.841468+0000","last_fullsized":"2024-02-26T12:20:07.841468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841807+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:07.841807+0000","last_peered":"2024-02-26T12:20:07.841807+0000","last_clean":"2024-02-26T12:20:07.841807+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:07.841807+0000","last_undegraded":"2024-02-26T12:20:07.841807+0000","last_fullsized":"2024-02-26T12:20:07.841807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352439+0000","last_change":"2024-02-26T12:20:06.851971+0000","last_active":"2024-02-26T12:20:08.352439+0000","last_peered":"2024-02-26T12:20:08.352439+0000","last_clean":"2024-02-26T12:20:08.352439+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:08.352439+0000","last_undegraded":"2024-02-26T12:20:08.352439+0000","last_fullsized":"2024-02-26T12:20:08.352439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841761+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:07.841761+0000","last_peered":"2024-02-26T12:20:07.841761+0000","last_clean":"2024-02-26T12:20:07.841761+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:07.841761+0000","last_undegraded":"2024-02-26T12:20:07.841761+0000","last_fullsized":"2024-02-26T12:20:07.841761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352170+0000","last_change":"2024-02-26T12:20:06.841194+0000","last_active":"2024-02-26T12:20:08.352170+0000","last_peered":"2024-02-26T12:20:08.352170+0000","last_clean":"2024-02-26T12:20:08.352170+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:08.352170+0000","last_undegraded":"2024-02-26T12:20:08.352170+0000","last_fullsized":"2024-02-26T12:20:08.352170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:36.378565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842034+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:07.842034+0000","last_peered":"2024-02-26T12:20:07.842034+0000","last_clean":"2024-02-26T12:20:07.842034+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:07.842034+0000","last_undegraded":"2024-02-26T12:20:07.842034+0000","last_fullsized":"2024-02-26T12:20:07.842034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.841086+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:45.667456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840347+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:07.840347+0000","last_peered":"2024-02-26T12:20:07.840347+0000","last_clean":"2024-02-26T12:20:07.840347+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:07.840347+0000","last_undegraded":"2024-02-26T12:20:07.840347+0000","last_fullsized":"2024-02-26T12:20:07.840347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352358+0000","last_change":"2024-02-26T12:20:06.847035+0000","last_active":"2024-02-26T12:20:08.352358+0000","last_peered":"2024-02-26T12:20:08.352358+0000","last_clean":"2024-02-26T12:20:08.352358+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:08.352358+0000","last_undegraded":"2024-02-26T12:20:08.352358+0000","last_fullsized":"2024-02-26T12:20:08.352358+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:44.444191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352952+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:08.352952+0000","last_peered":"2024-02-26T12:20:08.352952+0000","last_clean":"2024-02-26T12:20:08.352952+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:08.352952+0000","last_undegraded":"2024-02-26T12:20:08.352952+0000","last_fullsized":"2024-02-26T12:20:08.352952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.351951+0000","last_change":"2024-02-26T12:20:06.836131+0000","last_active":"2024-02-26T12:20:08.351951+0000","last_peered":"2024-02-26T12:20:08.351951+0000","last_clean":"2024-02-26T12:20:08.351951+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:08.351951+0000","last_undegraded":"2024-02-26T12:20:08.351951+0000","last_fullsized":"2024-02-26T12:20:08.351951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:37.734794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841367+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:07.841367+0000","last_peered":"2024-02-26T12:20:07.841367+0000","last_clean":"2024-02-26T12:20:07.841367+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:07.841367+0000","last_undegraded":"2024-02-26T12:20:07.841367+0000","last_fullsized":"2024-02-26T12:20:07.841367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352683+0000","last_change":"2024-02-26T12:20:06.843136+0000","last_active":"2024-02-26T12:20:08.352683+0000","last_peered":"2024-02-26T12:20:08.352683+0000","last_clean":"2024-02-26T12:20:08.352683+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:08.352683+0000","last_undegraded":"2024-02-26T12:20:08.352683+0000","last_fullsized":"2024-02-26T12:20:08.352683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840292+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:07.840292+0000","last_peered":"2024-02-26T12:20:07.840292+0000","last_clean":"2024-02-26T12:20:07.840292+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:07.840292+0000","last_undegraded":"2024-02-26T12:20:07.840292+0000","last_fullsized":"2024-02-26T12:20:07.840292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352037+0000","last_change":"2024-02-26T12:20:06.843988+0000","last_active":"2024-02-26T12:20:08.352037+0000","last_peered":"2024-02-26T12:20:08.352037+0000","last_clean":"2024-02-26T12:20:08.352037+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:08.352037+0000","last_undegraded":"2024-02-26T12:20:08.352037+0000","last_fullsized":"2024-02-26T12:20:08.352037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:08:15.222912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353068+0000","last_change":"2024-02-26T12:20:05.839678+0000","last_active":"2024-02-26T12:20:08.353068+0000","last_peered":"2024-02-26T12:20:08.353068+0000","last_clean":"2024-02-26T12:20:08.353068+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:08.353068+0000","last_undegraded":"2024-02-26T12:20:08.353068+0000","last_fullsized":"2024-02-26T12:20:08.353068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:13:50.360592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841445+0000","last_change":"2024-02-26T12:20:06.846498+0000","last_active":"2024-02-26T12:20:07.841445+0000","last_peered":"2024-02-26T12:20:07.841445+0000","last_clean":"2024-02-26T12:20:07.841445+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:07.841445+0000","last_undegraded":"2024-02-26T12:20:07.841445+0000","last_fullsized":"2024-02-26T12:20:07.841445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840598+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:07.840598+0000","last_peered":"2024-02-26T12:20:07.840598+0000","last_clean":"2024-02-26T12:20:07.840598+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:07.840598+0000","last_undegraded":"2024-02-26T12:20:07.840598+0000","last_fullsized":"2024-02-26T12:20:07.840598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840309+0000","last_change":"2024-02-26T12:20:06.840249+0000","last_active":"2024-02-26T12:20:07.840309+0000","last_peered":"2024-02-26T12:20:07.840309+0000","last_clean":"2024-02-26T12:20:07.840309+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:07.840309+0000","last_undegraded":"2024-02-26T12:20:07.840309+0000","last_fullsized":"2024-02-26T12:20:07.840309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352525+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:08.352525+0000","last_peered":"2024-02-26T12:20:08.352525+0000","last_clean":"2024-02-26T12:20:08.352525+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:08.352525+0000","last_undegraded":"2024-02-26T12:20:08.352525+0000","last_fullsized":"2024-02-26T12:20:08.352525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352648+0000","last_change":"2024-02-26T12:20:06.844149+0000","last_active":"2024-02-26T12:20:08.352648+0000","last_peered":"2024-02-26T12:20:08.352648+0000","last_clean":"2024-02-26T12:20:08.352648+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:08.352648+0000","last_undegraded":"2024-02-26T12:20:08.352648+0000","last_fullsized":"2024-02-26T12:20:08.352648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840470+0000","last_change":"2024-02-26T12:20:05.837864+0000","last_active":"2024-02-26T12:20:07.840470+0000","last_peered":"2024-02-26T12:20:07.840470+0000","last_clean":"2024-02-26T12:20:07.840470+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:07.840470+0000","last_undegraded":"2024-02-26T12:20:07.840470+0000","last_fullsized":"2024-02-26T12:20:07.840470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840357+0000","last_change":"2024-02-26T12:20:06.846886+0000","last_active":"2024-02-26T12:20:07.840357+0000","last_peered":"2024-02-26T12:20:07.840357+0000","last_clean":"2024-02-26T12:20:07.840357+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:07.840357+0000","last_undegraded":"2024-02-26T12:20:07.840357+0000","last_fullsized":"2024-02-26T12:20:07.840357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353099+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:08.353099+0000","last_peered":"2024-02-26T12:20:08.353099+0000","last_clean":"2024-02-26T12:20:08.353099+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:08.353099+0000","last_undegraded":"2024-02-26T12:20:08.353099+0000","last_fullsized":"2024-02-26T12:20:08.353099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:14:59.659011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352712+0000","last_change":"2024-02-26T12:20:06.849839+0000","last_active":"2024-02-26T12:20:08.352712+0000","last_peered":"2024-02-26T12:20:08.352712+0000","last_clean":"2024-02-26T12:20:08.352712+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:08.352712+0000","last_undegraded":"2024-02-26T12:20:08.352712+0000","last_fullsized":"2024-02-26T12:20:08.352712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841436+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:07.841436+0000","last_peered":"2024-02-26T12:20:07.841436+0000","last_clean":"2024-02-26T12:20:07.841436+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:07.841436+0000","last_undegraded":"2024-02-26T12:20:07.841436+0000","last_fullsized":"2024-02-26T12:20:07.841436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840423+0000","last_change":"2024-02-26T12:20:06.849696+0000","last_active":"2024-02-26T12:20:07.840423+0000","last_peered":"2024-02-26T12:20:07.840423+0000","last_clean":"2024-02-26T12:20:07.840423+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:07.840423+0000","last_undegraded":"2024-02-26T12:20:07.840423+0000","last_fullsized":"2024-02-26T12:20:07.840423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352941+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:08.352941+0000","last_peered":"2024-02-26T12:20:08.352941+0000","last_clean":"2024-02-26T12:20:08.352941+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:08.352941+0000","last_undegraded":"2024-02-26T12:20:08.352941+0000","last_fullsized":"2024-02-26T12:20:08.352941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:15.648437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352828+0000","last_change":"2024-02-26T12:20:06.839596+0000","last_active":"2024-02-26T12:20:08.352828+0000","last_peered":"2024-02-26T12:20:08.352828+0000","last_clean":"2024-02-26T12:20:08.352828+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:08.352828+0000","last_undegraded":"2024-02-26T12:20:08.352828+0000","last_fullsized":"2024-02-26T12:20:08.352828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352875+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:08.352875+0000","last_peered":"2024-02-26T12:20:08.352875+0000","last_clean":"2024-02-26T12:20:08.352875+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:08.352875+0000","last_undegraded":"2024-02-26T12:20:08.352875+0000","last_fullsized":"2024-02-26T12:20:08.352875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352681+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:08.352681+0000","last_peered":"2024-02-26T12:20:08.352681+0000","last_clean":"2024-02-26T12:20:08.352681+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:08.352681+0000","last_undegraded":"2024-02-26T12:20:08.352681+0000","last_fullsized":"2024-02-26T12:20:08.352681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:22.751 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-26T12:20:22.889 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.904+0000 7eff08288640 1 Processor -- start 2024-02-26T12:20:22.890 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.904+0000 7eff08288640 1 -- start start 2024-02-26T12:20:22.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff08288640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff000aed50 0x7eff0015e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff08288640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7eff0015bf80 0x7eff0015c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.891 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff08288640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0015eb60 con 0x7eff0006d250 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff08288640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000af130 con 0x7eff000aed50 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff08288640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0015ee40 con 0x7eff0015bf80 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff000aed50 0x7eff0015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff000aed50 0x7eff0015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43882/0 (socket says 172.21.15.113:43882) 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 -- 172.21.15.113:0/3836011855 learned_addr learned my addr 172.21.15.113:0/3836011855 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 -- 172.21.15.113:0/3836011855 >> v2:172.21.15.152:3300/0 conn(0x7eff0015bf80 msgr2=0x7eff0015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 --2- 172.21.15.113:0/3836011855 >> v2:172.21.15.152:3300/0 conn(0x7eff0015bf80 0x7eff0015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.892 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 -- 172.21.15.113:0/3836011855 >> v1:172.21.15.152:6789/0 conn(0x7eff0006d250 legacy=0x7eff000b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.905+0000 7eff06024640 1 -- 172.21.15.113:0/3836011855 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0015f120 con 0x7eff000aed50 2024-02-26T12:20:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.906+0000 7eff06024640 1 --2- 172.21.15.113:0/3836011855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff000aed50 0x7eff0015e460 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff000cc3d0 tx=0x7efefc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1a758347cc1a52 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.906+0000 7eff05022640 1 -- 172.21.15.113:0/3836011855 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc02ca80 con 0x7eff000aed50 2024-02-26T12:20:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.906+0000 7eff05022640 1 -- 172.21.15.113:0/3836011855 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc02cc20 con 0x7eff000aed50 2024-02-26T12:20:22.893 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.906+0000 7eff05022640 1 -- 172.21.15.113:0/3836011855 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0343f0 con 0x7eff000aed50 2024-02-26T12:20:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 -- 172.21.15.113:0/3836011855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff000aed50 msgr2=0x7eff0015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 --2- 172.21.15.113:0/3836011855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff000aed50 0x7eff0015e460 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff000cc3d0 tx=0x7efefc02bee0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 -- 172.21.15.113:0/3836011855 shutdown_connections 2024-02-26T12:20:22.895 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 --2- 172.21.15.113:0/3836011855 >> v2:172.21.15.152:3300/0 conn(0x7eff0015bf80 0x7eff0015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 --2- 172.21.15.113:0/3836011855 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff000aed50 0x7eff0015e460 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 -- 172.21.15.113:0/3836011855 >> 172.21.15.113:0/3836011855 conn(0x7eff0006ab50 msgr2=0x7eff0006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 -- 172.21.15.113:0/3836011855 shutdown_connections 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.907+0000 7eff08288640 1 -- 172.21.15.113:0/3836011855 wait complete. 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.908+0000 7eff08288640 1 Processor -- start 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.908+0000 7eff08288640 1 -- start start 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.896 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7eff000aed50 0x7eff0014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 0x7eff000ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b4050 con 0x7eff0006d250 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b3420 con 0x7eff0015bf80 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff08288640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b41d0 con 0x7eff000aed50 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43892/0 (socket says 172.21.15.113:43892) 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 -- 172.21.15.113:0/732309700 learned_addr learned my addr 172.21.15.113:0/732309700 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:22.897 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff05823640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7eff000aed50 0x7eff0014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06825640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 0x7eff000ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 -- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7eff000aed50 msgr2=0x7eff0014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7eff000aed50 0x7eff0014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 -- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 msgr2=0x7eff000ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 0x7eff000ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 -- 172.21.15.113:0/732309700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000a9b80 con 0x7eff0006d250 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06825640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 0x7eff000ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:22.898 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.909+0000 7eff06024640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efefc0093e0 tx=0x7efefc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.911+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc043020 con 0x7eff0006d250 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.911+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc03e450 con 0x7eff0006d250 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.911+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff000a9e60 con 0x7eff0006d250 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.911+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc03e840 con 0x7eff0006d250 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.912+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff000aa420 con 0x7eff0006d250 2024-02-26T12:20:22.900 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.912+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff00074a50 con 0x7eff0006d250 2024-02-26T12:20:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.913+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efefc046020 con 0x7eff0006d250 2024-02-26T12:20:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.913+0000 7efef6ffd640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 0x7efee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.913+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efefc0acc30 con 0x7eff0006d250 2024-02-26T12:20:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.913+0000 7eff05823640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 0x7efee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:22.901 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.914+0000 7eff05823640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 0x7efee406d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efef0007fd0 tx=0x7efef0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:22.902 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:22.917+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efefc04d030 con 0x7eff0006d250 2024-02-26T12:20:23.073 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.088+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff0015bc20 con 0x7eff0006d250 2024-02-26T12:20:23.074 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.089+0000 7efef6ffd640 1 -- 172.21.15.113:0/732309700 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16693 (secure 0 0 0) 0x7efefc07bab0 con 0x7eff0006d250 2024-02-26T12:20:23.074 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:23.074 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":31,"fsid":"74a57275-9dde-4d5b-99d3-80ee62f4964a","created":"2024-02-26T12:18:54.966251+0000","modified":"2024-02-26T12:20:07.833837+0000","last_up_change":"2024-02-26T12:19:05.671027+0000","last_in_change":"2024-02-26T12:18:57.179821+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-26T12:19:07.195487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-02-26T12:20:04.388376+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-02-26T12:20:05.144745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fa5c4e6-2450-4dc5-90ad-b2e735aa1a4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6824","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6825","nonce":228866961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6827","nonce":228866961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6831","nonce":228866961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":228866961},{"type":"v1","addr":"172.21.15.113:6829","nonce":228866961}]},"public_addr":"172.21.15.113:6825/228866961","cluster_addr":"172.21.15.113:6827/228866961","heartbeat_back_addr":"172.21.15.113:6831/228866961","heartbeat_front_addr":"172.21.15.113:6829/228866961","state":["exists","up"]},{"osd":1,"uuid":"f6116b70-0a14-4ddc-9bd4-53360e938106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6809","nonce":1831062802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6810","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6811","nonce":1831062802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6814","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6815","nonce":1831062802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":1831062802},{"type":"v1","addr":"172.21.15.113:6813","nonce":1831062802}]},"public_addr":"172.21.15.113:6809/1831062802","cluster_addr":"172.21.15.113:6811/1831062802","heartbeat_back_addr":"172.21.15.113:6815/1831062802","heartbeat_front_addr":"172.21.15.113:6813/1831062802","state":["exists","up"]},{"osd":2,"uuid":"690d29c3-8e30-4279-b1bc-45eab0e3476f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6817","nonce":1378425100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6818","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6819","nonce":1378425100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6823","nonce":1378425100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":1378425100},{"type":"v1","addr":"172.21.15.113:6821","nonce":1378425100}]},"public_addr":"172.21.15.113:6817/1378425100","cluster_addr":"172.21.15.113:6819/1378425100","heartbeat_back_addr":"172.21.15.113:6823/1378425100","heartbeat_front_addr":"172.21.15.113:6821/1378425100","state":["exists","up"]},{"osd":3,"uuid":"ca0ec18b-2307-4b89-a95c-2394cf1a919c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6801","nonce":3789965285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6803","nonce":3789965285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6807","nonce":3789965285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":3789965285},{"type":"v1","addr":"172.21.15.113:6805","nonce":3789965285}]},"public_addr":"172.21.15.113:6801/3789965285","cluster_addr":"172.21.15.113:6803/3789965285","heartbeat_back_addr":"172.21.15.113:6807/3789965285","heartbeat_front_addr":"172.21.15.113:6805/3789965285","state":["exists","up"]},{"osd":4,"uuid":"71957897-b9e1-4a3b-88c3-48f02bfa28d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6817","nonce":1514413955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6819","nonce":1514413955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6823","nonce":1514413955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1514413955},{"type":"v1","addr":"172.21.15.152:6821","nonce":1514413955}]},"public_addr":"172.21.15.152:6817/1514413955","cluster_addr":"172.21.15.152:6819/1514413955","heartbeat_back_addr":"172.21.15.152:6823/1514413955","heartbeat_front_addr":"172.21.15.152:6821/1514413955","state":["exists","up"]},{"osd":5,"uuid":"a682819f-83df-46de-9f97-803d7f474dd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6825","nonce":237296747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6827","nonce":237296747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6831","nonce":237296747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":237296747},{"type":"v1","addr":"172.21.15.152:6829","nonce":237296747}]},"public_addr":"172.21.15.152:6825/237296747","cluster_addr":"172.21.15.152:6827/237296747","heartbeat_back_addr":"172.21.15.152:6831/237296747","heartbeat_front_addr":"172.21.15.152:6829/237296747","state":["exists","up"]},{"osd":6,"uuid":"05d5b4ae-b376-4ed3-a368-eaf5bd92aaf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6801","nonce":4099407341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6803","nonce":4099407341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6807","nonce":4099407341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":4099407341},{"type":"v1","addr":"172.21.15.152:6805","nonce":4099407341}]},"public_addr":"172.21.15.152:6801/4099407341","cluster_addr":"172.21.15.152:6803/4099407341","heartbeat_back_addr":"172.21.15.152:6807/4099407341","heartbeat_front_addr":"172.21.15.152:6805/4099407341","state":["exists","up"]},{"osd":7,"uuid":"22317452-dd22-4bb2-8983-46a31d9f720d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6809","nonce":276006357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6811","nonce":276006357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6815","nonce":276006357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":276006357},{"type":"v1","addr":"172.21.15.152:6813","nonce":276006357}]},"public_addr":"172.21.15.152:6809/276006357","cluster_addr":"172.21.15.152:6811/276006357","heartbeat_back_addr":"172.21.15.152:6815/276006357","heartbeat_front_addr":"172.21.15.152:6813/276006357","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.352661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.287722+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.325326+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.354051+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.311872+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.362373+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.292692+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-26T12:19:02.290164+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-26T12:20:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 msgr2=0x7efee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 0x7efee406d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efef0007fd0 tx=0x7efef0009040 comp rx=0 tx=0).stop 2024-02-26T12:20:23.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 msgr2=0x7eff000a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efefc0093e0 tx=0x7efefc004a40 comp rx=0 tx=0).stop 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 shutdown_connections 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7efee406b4d0 0x7efee406d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff0015bf80 0x7eff000ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7eff000aed50 0x7eff0014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 --2- 172.21.15.113:0/732309700 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0006d250 0x7eff000a94f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 >> 172.21.15.113:0/732309700 conn(0x7eff0006ab50 msgr2=0x7eff000b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:23.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 shutdown_connections 2024-02-26T12:20:23.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:23.091+0000 7eff08288640 1 -- 172.21.15.113:0/732309700 wait complete. 2024-02-26T12:20:24.087 INFO:tasks.ceph:Scrubbing osd.0 2024-02-26T12:20:24.088 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:24.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.215+0000 7f99bbede640 1 Processor -- start 2024-02-26T12:20:24.201 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 -- start start 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f99b40cf930 0x7f99b40cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f99b40d02f0 0x7f99b40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40b2920 con 0x7f99b415bca0 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40b1da0 con 0x7f99b40d02f0 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.216+0000 7f99bbede640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40b2080 con 0x7f99b40cf930 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99b9c7a640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f99b415bca0 0x7f99b40b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44970/0 (socket says 172.21.15.113:44970) 2024-02-26T12:20:24.203 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99b9c7a640 1 -- 172.21.15.113:0/2506851524 learned_addr learned my addr 172.21.15.113:0/2506851524 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99ba47b640 1 --2- 172.21.15.113:0/2506851524 >> v2:172.21.15.113:3300/0 conn(0x7f99b40d02f0 0x7f99b40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99b9479640 1 --2- 172.21.15.113:0/2506851524 >> v2:172.21.15.152:3300/0 conn(0x7f99b40cf930 0x7f99b40cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99b8c78640 1 -- 172.21.15.113:0/2506851524 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80232040 0 0) 0x7f99b40b2920 con 0x7f99b415bca0 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99b8c78640 1 -- 172.21.15.113:0/2506851524 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a0003520 con 0x7f99b415bca0 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99ba47b640 1 -- 172.21.15.113:0/2506851524 >> v2:172.21.15.152:3300/0 conn(0x7f99b40cf930 msgr2=0x7f99b40cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99ba47b640 1 --2- 172.21.15.113:0/2506851524 >> v2:172.21.15.152:3300/0 conn(0x7f99b40cf930 0x7f99b40cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99ba47b640 1 -- 172.21.15.113:0/2506851524 >> v1:172.21.15.113:6789/0 conn(0x7f99b415bca0 legacy=0x7f99b40b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.204 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.217+0000 7f99ba47b640 1 -- 172.21.15.113:0/2506851524 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40b2360 con 0x7f99b40d02f0 2024-02-26T12:20:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99ba47b640 1 --2- 172.21.15.113:0/2506851524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40d02f0 0x7f99b40cc880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f99b40d27b0 tx=0x7f99ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1232129ce201550 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99b8c78640 1 -- 172.21.15.113:0/2506851524 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac035020 con 0x7f99b40d02f0 2024-02-26T12:20:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99b8c78640 1 -- 172.21.15.113:0/2506851524 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac031830 con 0x7f99b40d02f0 2024-02-26T12:20:24.205 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99b8c78640 1 -- 172.21.15.113:0/2506851524 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac031c00 con 0x7f99b40d02f0 2024-02-26T12:20:24.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 -- 172.21.15.113:0/2506851524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40d02f0 msgr2=0x7f99b40cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 --2- 172.21.15.113:0/2506851524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40d02f0 0x7f99b40cc880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f99b40d27b0 tx=0x7f99ac02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 -- 172.21.15.113:0/2506851524 shutdown_connections 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 --2- 172.21.15.113:0/2506851524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40d02f0 0x7f99b40cc880 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 --2- 172.21.15.113:0/2506851524 >> v2:172.21.15.152:3300/0 conn(0x7f99b40cf930 0x7f99b40cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.218+0000 7f99bbede640 1 -- 172.21.15.113:0/2506851524 >> 172.21.15.113:0/2506851524 conn(0x7f99b40d1920 msgr2=0x7f99b40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.219+0000 7f99bbede640 1 -- 172.21.15.113:0/2506851524 shutdown_connections 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.219+0000 7f99bbede640 1 -- 172.21.15.113:0/2506851524 wait complete. 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 Processor -- start 2024-02-26T12:20:24.209 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 -- start start 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 0x7f99b414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99b40d02f0 0x7f99b415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99b415bca0 0x7f99b40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40ccdc0 con 0x7f99b40cf930 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40d0760 con 0x7f99b40d02f0 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99bbede640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40ccf40 con 0x7f99b415bca0 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99b9c7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 0x7f99b414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99b9c7a640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 0x7f99b414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43922/0 (socket says 172.21.15.113:43922) 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.220+0000 7f99b9c7a640 1 -- 172.21.15.113:0/2095771024 learned_addr learned my addr 172.21.15.113:0/2095771024 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 -- 172.21.15.113:0/2095771024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99b415bca0 msgr2=0x7f99b40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f99b415bca0 0x7f99b40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 -- 172.21.15.113:0/2095771024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99b40d02f0 msgr2=0x7f99b415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99b40d02f0 0x7f99b415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b414e2c0 con 0x7f99b40cf930 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99b9c7a640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 0x7f99b414dd80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f99b0002230 tx=0x7f99b000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.211 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0017070 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000ac30 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0012640 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b415d610 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.221+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b415dbc0 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.222+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99b40b47e0 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.222+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99b001a070 con 0x7f99b40cf930 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99aa7fc640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f999806b4d0 0x7f999806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.212 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b0089ed0 con 0x7f99b40cf930 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99b9479640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f999806b4d0 0x7f999806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99aa7fc640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f99980736d0 0x7f9998075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99b0014ec0 con 0x7f99980736d0 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b008c5d0 con 0x7f99b40cf930 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99ba47b640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f99980736d0 0x7f9998075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.223+0000 7f99b9479640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f999806b4d0 0x7f999806d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99b415ec20 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.224+0000 7f99ba47b640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f99980736d0 0x7f9998075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.224+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== osd.0 v2:172.21.15.113:6824/228866961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f99b0014ec0 con 0x7f99980736d0 2024-02-26T12:20:24.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.237+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 --> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f99b4157200 con 0x7f99980736d0 2024-02-26T12:20:24.223 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.237+0000 7f99aa7fc640 1 -- 172.21.15.113:0/2095771024 <== osd.0 v2:172.21.15.113:6824/228866961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f99b4157200 con 0x7f99980736d0 2024-02-26T12:20:24.223 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:24.223 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:24.223 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f99980736d0 msgr2=0x7f9998075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6824/228866961,v1:172.21.15.113:6825/228866961] conn(0x7f99980736d0 0x7f9998075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f999806b4d0 msgr2=0x7f999806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f999806b4d0 0x7f999806d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f99b415ec20 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 msgr2=0x7f99b414dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 --2- 172.21.15.113:0/2095771024 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f99b40cf930 0x7f99b414dd80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f99b0002230 tx=0x7f99b000cf70 comp rx=0 tx=0).stop 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99ba47b640 1 -- 172.21.15.113:0/2095771024 reap_dead start 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 shutdown_connections 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 >> 172.21.15.113:0/2095771024 conn(0x7f99b40d1920 msgr2=0x7f99b40b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 shutdown_connections 2024-02-26T12:20:24.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.238+0000 7f99bbede640 1 -- 172.21.15.113:0/2095771024 wait complete. 2024-02-26T12:20:24.233 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-26T12:20:24.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.350+0000 7ff76df1e640 1 Processor -- start 2024-02-26T12:20:24.335 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.350+0000 7ff76df1e640 1 -- start start 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.350+0000 7ff76df1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff768161780 0x7ff768161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff76df1e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7680b52f0 con 0x7ff76806e9c0 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff76df1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7680af2a0 con 0x7ff768147020 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff76df1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680af580 con 0x7ff768161780 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff766ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff768161780 0x7ff768161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff767fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff76806e9c0 0x7ff76806ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44984/0 (socket says 172.21.15.113:44984) 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff767fff640 1 -- 172.21.15.113:0/1965829572 learned_addr learned my addr 172.21.15.113:0/1965829572 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:24.337 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff766ffd640 1 -- 172.21.15.113:0/1965829572 >> v1:172.21.15.152:6789/0 conn(0x7ff768147020 legacy=0x7ff7680b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff766ffd640 1 -- 172.21.15.113:0/1965829572 >> v1:172.21.15.113:6789/0 conn(0x7ff76806e9c0 legacy=0x7ff76806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.351+0000 7ff766ffd640 1 -- 172.21.15.113:0/1965829572 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680b5590 con 0x7ff768161780 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff766ffd640 1 --2- 172.21.15.113:0/1965829572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768161780 0x7ff768161c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097a0 tx=0x7ff75c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82c7d8301191af9 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff7667fc640 1 -- 172.21.15.113:0/1965829572 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c035020 con 0x7ff768161780 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff7667fc640 1 -- 172.21.15.113:0/1965829572 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c031830 con 0x7ff768161780 2024-02-26T12:20:24.338 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff7667fc640 1 -- 172.21.15.113:0/1965829572 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c031c00 con 0x7ff768161780 2024-02-26T12:20:24.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 -- 172.21.15.113:0/1965829572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768161780 msgr2=0x7ff768161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 --2- 172.21.15.113:0/1965829572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768161780 0x7ff768161c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097a0 tx=0x7ff75c02b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.341 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 -- 172.21.15.113:0/1965829572 shutdown_connections 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 --2- 172.21.15.113:0/1965829572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768161780 0x7ff768161c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 -- 172.21.15.113:0/1965829572 >> 172.21.15.113:0/1965829572 conn(0x7ff768071730 msgr2=0x7ff768071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 -- 172.21.15.113:0/1965829572 shutdown_connections 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.352+0000 7ff76df1e640 1 -- 172.21.15.113:0/1965829572 wait complete. 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.353+0000 7ff76df1e640 1 Processor -- start 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 -- start start 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff76806e9c0 0x7ff7681452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.342 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff768161780 0x7ff7680ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7681476a0 con 0x7ff768147020 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680b5900 con 0x7ff76806e9c0 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff76df1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff768147820 con 0x7ff768161780 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff766ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff766ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43938/0 (socket says 172.21.15.113:43938) 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.354+0000 7ff766ffd640 1 -- 172.21.15.113:0/3383427171 learned_addr learned my addr 172.21.15.113:0/3383427171 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:24.343 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 -- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff768161780 msgr2=0x7ff7680ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff768161780 0x7ff7680ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 -- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff76806e9c0 msgr2=0x7ff7681452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff76806e9c0 0x7ff7681452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 -- 172.21.15.113:0/3383427171 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768145810 con 0x7ff768147020 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff766ffd640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff75c034040 tx=0x7ff75c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c041070 con 0x7ff768147020 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c03a990 con 0x7ff768147020 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76813c060 con 0x7ff768147020 2024-02-26T12:20:24.344 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c035040 con 0x7ff768147020 2024-02-26T12:20:24.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.355+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76813c620 con 0x7ff768147020 2024-02-26T12:20:24.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.356+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7680b3c60 con 0x7ff768147020 2024-02-26T12:20:24.345 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.356+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff75c04c060 con 0x7ff768147020 2024-02-26T12:20:24.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.357+0000 7ff74ffff640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 0x7ff75406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.357+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff75c0abc10 con 0x7ff768147020 2024-02-26T12:20:24.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.357+0000 7ff7677fe640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 0x7ff75406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.357+0000 7ff7677fe640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 0x7ff75406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7680aea80 tx=0x7ff7580079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.346 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.361+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7680b3c60 con 0x7ff768147020 2024-02-26T12:20:24.517 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.532+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff76813be10 con 0x7ff75406b4d0 2024-02-26T12:20:24.518 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.532+0000 7ff74ffff640 1 -- 172.21.15.113:0/3383427171 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff76813be10 con 0x7ff75406b4d0 2024-02-26T12:20:24.518 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 0 to deep-scrub 2024-02-26T12:20:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 msgr2=0x7ff75406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 0x7ff75406d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7680aea80 tx=0x7ff7580079b0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 msgr2=0x7ff7680ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff75c034040 tx=0x7ff75c0046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 shutdown_connections 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7ff75406b4d0 0x7ff75406d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff768161780 0x7ff7680ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff768147020 0x7ff7680ad900 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 --2- 172.21.15.113:0/3383427171 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff76806e9c0 0x7ff7681452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.534+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 >> 172.21.15.113:0/3383427171 conn(0x7ff768071730 msgr2=0x7ff7680b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.535+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 shutdown_connections 2024-02-26T12:20:24.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.535+0000 7ff76df1e640 1 -- 172.21.15.113:0/3383427171 wait complete. 2024-02-26T12:20:24.530 INFO:tasks.ceph:Scrubbing osd.1 2024-02-26T12:20:24.531 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:24.635 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.650+0000 7fdbebb15640 1 Processor -- start 2024-02-26T12:20:24.636 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 -- start start 2024-02-26T12:20:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b570 0x7fdbe4099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdbe4099f80 0x7fdbe406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe409aa40 con 0x7fdbe415b950 2024-02-26T12:20:24.637 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe409a4a0 con 0x7fdbe4099f80 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbebb15640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409a760 con 0x7fdbe415b570 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbea0b2640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdbe4099f80 0x7fdbe406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.651+0000 7fdbe90b0640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fdbe415b950 0x7fdbe40cfab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44998/0 (socket says 172.21.15.113:44998) 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbe90b0640 1 -- 172.21.15.113:0/3335246617 learned_addr learned my addr 172.21.15.113:0/3335246617 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbea0b2640 1 -- 172.21.15.113:0/3335246617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b570 msgr2=0x7fdbe4099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbe98b1640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b570 0x7fdbe4099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbea0b2640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b570 0x7fdbe4099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.638 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbea0b2640 1 -- 172.21.15.113:0/3335246617 >> v1:172.21.15.113:6789/0 conn(0x7fdbe415b950 legacy=0x7fdbe40cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbe88af640 1 -- 172.21.15.113:0/3335246617 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585398148 0 0) 0x7fdbe409aa40 con 0x7fdbe415b950 2024-02-26T12:20:24.639 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.652+0000 7fdbea0b2640 1 -- 172.21.15.113:0/3335246617 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe406bd90 con 0x7fdbe4099f80 2024-02-26T12:20:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbea0b2640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe4099f80 0x7fdbe406c590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0097a0 tx=0x7fdbdc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e03ac8a4e5c890a server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbe88af640 1 -- 172.21.15.113:0/3335246617 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc038070 con 0x7fdbe4099f80 2024-02-26T12:20:24.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbe88af640 1 -- 172.21.15.113:0/3335246617 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc031700 con 0x7fdbe4099f80 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbe88af640 1 -- 172.21.15.113:0/3335246617 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc031ad0 con 0x7fdbe4099f80 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 -- 172.21.15.113:0/3335246617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe4099f80 msgr2=0x7fdbe406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe4099f80 0x7fdbe406c590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0097a0 tx=0x7fdbdc02b7a0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 -- 172.21.15.113:0/3335246617 shutdown_connections 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe4099f80 0x7fdbe406c590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 --2- 172.21.15.113:0/3335246617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b570 0x7fdbe4099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 -- 172.21.15.113:0/3335246617 >> 172.21.15.113:0/3335246617 conn(0x7fdbe40d1920 msgr2=0x7fdbe40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 -- 172.21.15.113:0/3335246617 shutdown_connections 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.653+0000 7fdbebb15640 1 -- 172.21.15.113:0/3335246617 wait complete. 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.654+0000 7fdbebb15640 1 Processor -- start 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.654+0000 7fdbebb15640 1 -- start start 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe4099f80 0x7fdbe41f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 0x7fdbe40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b950 0x7fdbe40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40d0340 con 0x7fdbe415b570 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40d01c0 con 0x7fdbe4099f80 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbebb15640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe406cad0 con 0x7fdbe415b950 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbe90b0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 0x7fdbe40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbe90b0640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 0x7fdbe40c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43954/0 (socket says 172.21.15.113:43954) 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbe90b0640 1 -- 172.21.15.113:0/2896831606 learned_addr learned my addr 172.21.15.113:0/2896831606 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbe90b0640 1 -- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b950 msgr2=0x7fdbe40c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.655+0000 7fdbea0b2640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b950 0x7fdbe40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe90b0640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdbe415b950 0x7fdbe40c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe90b0640 1 -- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe4099f80 msgr2=0x7fdbe41f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe98b1640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe4099f80 0x7fdbe41f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe90b0640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdbe4099f80 0x7fdbe41f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe90b0640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe41f79f0 con 0x7fdbe415b570 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe90b0640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 0x7fdbe40c89f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c3c0 tx=0x7fdbd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80074e0 con 0x7fdbe415b570 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80047e0 con 0x7fdbe415b570 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe40ae520 con 0x7fdbe415b570 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004bd0 con 0x7fdbe415b570 2024-02-26T12:20:24.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.656+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe40aeae0 con 0x7fdbe415b570 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.657+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbe4074a50 con 0x7fdbe415b570 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.657+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdbd8011070 con 0x7fdbe415b570 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe27fc640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdbd006b500 0x7fdbd006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbd8089d40 con 0x7fdbe415b570 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe98b1640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdbd006b500 0x7fdbd006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe27fc640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7fdbd00736a0 0x7fdbd0075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbd800ee50 con 0x7fdbd00736a0 2024-02-26T12:20:24.648 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbd808c440 con 0x7fdbe415b570 2024-02-26T12:20:24.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbea0b2640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7fdbd00736a0 0x7fdbd0075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbe98b1640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdbd006b500 0x7fdbd006d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b0710 tx=0x7fdbd4008460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.658+0000 7fdbea0b2640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7fdbd00736a0 0x7fdbd0075ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.649 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.659+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== osd.1 v2:172.21.15.113:6808/1831062802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdbd800ee50 con 0x7fdbd00736a0 2024-02-26T12:20:24.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.672+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 --> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdbe40b14b0 con 0x7fdbd00736a0 2024-02-26T12:20:24.657 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.672+0000 7fdbe27fc640 1 -- 172.21.15.113:0/2896831606 <== osd.1 v2:172.21.15.113:6808/1831062802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdbe40b14b0 con 0x7fdbd00736a0 2024-02-26T12:20:24.658 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:24.658 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:24.658 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:24.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7fdbd00736a0 msgr2=0x7fdbd0075ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6808/1831062802,v1:172.21.15.113:6809/1831062802] conn(0x7fdbd00736a0 0x7fdbd0075ac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdbd006b500 msgr2=0x7fdbd006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fdbd006b500 0x7fdbd006d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b0710 tx=0x7fdbd4008460 comp rx=0 tx=0).stop 2024-02-26T12:20:24.659 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 msgr2=0x7fdbe40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 --2- 172.21.15.113:0/2896831606 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdbe415b570 0x7fdbe40c89f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800c3c0 tx=0x7fdbd800c880 comp rx=0 tx=0).stop 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbea0b2640 1 -- 172.21.15.113:0/2896831606 reap_dead start 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 shutdown_connections 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 >> 172.21.15.113:0/2896831606 conn(0x7fdbe40d1920 msgr2=0x7fdbe40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 shutdown_connections 2024-02-26T12:20:24.660 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.673+0000 7fdbebb15640 1 -- 172.21.15.113:0/2896831606 wait complete. 2024-02-26T12:20:24.668 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-26T12:20:24.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.784+0000 7f5489088640 1 Processor -- start 2024-02-26T12:20:24.770 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.784+0000 7f5489088640 1 -- start start 2024-02-26T12:20:24.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.785+0000 7f5489088640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 0x7f54840b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.785+0000 7f5489088640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 0x7f54840d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.771 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.785+0000 7f5489088640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840d2550 con 0x7f548415dce0 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.785+0000 7f5489088640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548415e0c0 con 0x7f54840ceef0 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.785+0000 7f5489088640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840d2830 con 0x7f54840d35f0 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548259c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 0x7f54840b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548359e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 0x7f54840d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f5482d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f548415dce0 0x7f54840ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:39244/0 (socket says 172.21.15.113:39244) 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f5482d9d640 1 -- 172.21.15.113:0/150386296 learned_addr learned my addr 172.21.15.113:0/150386296 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:24.772 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548359e640 1 -- 172.21.15.113:0/150386296 >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 msgr2=0x7f54840b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:24.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548359e640 1 --2- 172.21.15.113:0/150386296 >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 0x7f54840b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548359e640 1 -- 172.21.15.113:0/150386296 >> v1:172.21.15.152:6789/0 conn(0x7f548415dce0 legacy=0x7f54840ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548359e640 1 -- 172.21.15.113:0/150386296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840d2b10 con 0x7f54840d35f0 2024-02-26T12:20:24.773 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.786+0000 7f548259c640 1 --2- 172.21.15.113:0/150386296 >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 0x7f54840b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:24.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f548359e640 1 --2- 172.21.15.113:0/150386296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 0x7f54840d1e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54740097a0 tx=0x7f547402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203d2b489ed540d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.776 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5481d9b640 1 -- 172.21.15.113:0/150386296 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474035020 con 0x7f54840d35f0 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5481d9b640 1 -- 172.21.15.113:0/150386296 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474031830 con 0x7f54840d35f0 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5481d9b640 1 -- 172.21.15.113:0/150386296 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474031c00 con 0x7f54840d35f0 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5489088640 1 -- 172.21.15.113:0/150386296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 msgr2=0x7f54840d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5489088640 1 --2- 172.21.15.113:0/150386296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 0x7f54840d1e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54740097a0 tx=0x7f547402b8d0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5489088640 1 -- 172.21.15.113:0/150386296 shutdown_connections 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.787+0000 7f5489088640 1 --2- 172.21.15.113:0/150386296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54840d35f0 0x7f54840d1e70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.788+0000 7f5489088640 1 --2- 172.21.15.113:0/150386296 >> v2:172.21.15.152:3300/0 conn(0x7f54840ceef0 0x7f54840b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.777 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.788+0000 7f5489088640 1 -- 172.21.15.113:0/150386296 >> 172.21.15.113:0/150386296 conn(0x7f54840b5620 msgr2=0x7f54840b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.788+0000 7f5489088640 1 -- 172.21.15.113:0/150386296 shutdown_connections 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.788+0000 7f5489088640 1 -- 172.21.15.113:0/150386296 wait complete. 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.789+0000 7f5489088640 1 Processor -- start 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.789+0000 7f5489088640 1 -- start start 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 0x7f548415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f548415dce0 0x7f548415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.778 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b6c40 con 0x7f54840d35f0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840d30d0 con 0x7f54840ceef0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5489088640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b6dc0 con 0x7f548415dce0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43960/0 (socket says 172.21.15.113:43960) 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 -- 172.21.15.113:0/234431572 learned_addr learned my addr 172.21.15.113:0/234431572 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5482d9d640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 0x7f548415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548359e640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f548415dce0 0x7f548415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 -- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f548415dce0 msgr2=0x7f548415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.779 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f548415dce0 0x7f548415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 -- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 msgr2=0x7f548415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 0x7f548415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 -- 172.21.15.113:0/234431572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484156830 con 0x7f54840d35f0 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f5482d9d640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 0x7f548415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.790+0000 7f548259c640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f546c00ebe0 tx=0x7f546c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.791+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c017070 con 0x7f54840d35f0 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.791+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c00cc30 con 0x7f54840d35f0 2024-02-26T12:20:24.780 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.791+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54841f3880 con 0x7f54840d35f0 2024-02-26T12:20:24.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.791+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c013470 con 0x7f54840d35f0 2024-02-26T12:20:24.781 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.791+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54841610d0 con 0x7f54840d35f0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.792+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5484074a50 con 0x7f54840d35f0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.792+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f546c01a070 con 0x7f54840d35f0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.792+0000 7f547b7fe640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 0x7f546406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.792+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f546c08a120 con 0x7f54840d35f0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.792+0000 7f5482d9d640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 0x7f546406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.793+0000 7f5482d9d640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 0x7f546406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f547c0012e0 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:24.782 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.797+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f546c058fa0 con 0x7f54840d35f0 2024-02-26T12:20:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.968+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f548406b180 con 0x7f546406b4d0 2024-02-26T12:20:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.969+0000 7f547b7fe640 1 -- 172.21.15.113:0/234431572 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f548406b180 con 0x7f546406b4d0 2024-02-26T12:20:24.954 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 1 to deep-scrub 2024-02-26T12:20:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 msgr2=0x7f546406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 0x7f546406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f547c0012e0 tx=0x7f547c009040 comp rx=0 tx=0).stop 2024-02-26T12:20:24.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 msgr2=0x7f548415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f546c00ebe0 tx=0x7f546c00c520 comp rx=0 tx=0).stop 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 shutdown_connections 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f546406b4d0 0x7f546406d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f548415dce0 0x7f548415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54840d35f0 0x7f548415e270 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 --2- 172.21.15.113:0/234431572 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54840ceef0 0x7f548415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 >> 172.21.15.113:0/234431572 conn(0x7f54840b5620 msgr2=0x7f548406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:24.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 shutdown_connections 2024-02-26T12:20:24.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:24.971+0000 7f5489088640 1 -- 172.21.15.113:0/234431572 wait complete. 2024-02-26T12:20:24.967 INFO:tasks.ceph:Scrubbing osd.2 2024-02-26T12:20:24.967 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.086+0000 7fe797ded640 1 Processor -- start 2024-02-26T12:20:25.071 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.086+0000 7fe797ded640 1 -- start start 2024-02-26T12:20:25.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe797ded640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe790168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.075 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe797ded640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79015e0a0 con 0x7fe79015dcc0 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe797ded640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900cacc0 con 0x7fe7900c35a0 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe797ded640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cc540 con 0x7fe7900cf8c0 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe795b89640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fe79015dcc0 0x7fe79006b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45006/0 (socket says 172.21.15.113:45006) 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe795b89640 1 -- 172.21.15.113:0/3234489413 learned_addr learned my addr 172.21.15.113:0/3234489413 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe79638a640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe790168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174062563 0 0) 0x7fe79015e0a0 con 0x7fe79015dcc0 2024-02-26T12:20:25.076 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c003520 con 0x7fe79015dcc0 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310824095 0 0) 0x7fe7900cacc0 con 0x7fe7900c35a0 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe79015e0a0 con 0x7fe7900c35a0 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3973445285 0 0) 0x7fe77c003520 con 0x7fe79015dcc0 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 msgr2=0x7fe790168bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe790168bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.077 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 >> v1:172.21.15.152:6789/0 conn(0x7fe7900c35a0 legacy=0x7fe79006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900ca700 con 0x7fe79015dcc0 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fe78c001670 con 0x7fe79015dcc0 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 >> v1:172.21.15.113:6789/0 conn(0x7fe79015dcc0 legacy=0x7fe79006b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe77c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c0040d0 0x7fe77c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe77c004d40 0x7fe77c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cc540 con 0x7fe77c004d40 2024-02-26T12:20:25.078 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00bb50 con 0x7fe77c0040d0 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.087+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00bd20 con 0x7fe7900cf8c0 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe77c004d40 0x7fe77c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe795b89640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe77c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe795388640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c0040d0 0x7fe77c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 -- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 msgr2=0x7fe77c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe7900cf8c0 0x7fe77c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 -- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c0040d0 msgr2=0x7fe77c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe77c0040d0 0x7fe77c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.088+0000 7fe79638a640 1 -- 172.21.15.113:0/3234489413 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c003520 con 0x7fe77c004d40 2024-02-26T12:20:25.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe79638a640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe77c004d40 0x7fe77c0051c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe788009fc0 tx=0x7fe77c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36bc262a1a1f0ea server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788039070 con 0x7fe77c004d40 2024-02-26T12:20:25.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78802cc20 con 0x7fe77c004d40 2024-02-26T12:20:25.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe794b87640 1 -- 172.21.15.113:0/3234489413 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788009c10 con 0x7fe77c004d40 2024-02-26T12:20:25.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 -- 172.21.15.113:0/3234489413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe77c004d40 msgr2=0x7fe77c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 --2- 172.21.15.113:0/3234489413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe77c004d40 0x7fe77c0051c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe788009fc0 tx=0x7fe77c005830 comp rx=0 tx=0).stop 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe79638a640 1 -- 172.21.15.113:0/3234489413 reap_dead start 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 -- 172.21.15.113:0/3234489413 shutdown_connections 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 -- 172.21.15.113:0/3234489413 >> 172.21.15.113:0/3234489413 conn(0x7fe7900cc990 msgr2=0x7fe7900ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 -- 172.21.15.113:0/3234489413 shutdown_connections 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.089+0000 7fe797ded640 1 -- 172.21.15.113:0/3234489413 wait complete. 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.090+0000 7fe797ded640 1 Processor -- start 2024-02-26T12:20:25.081 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.090+0000 7fe797ded640 1 -- start start 2024-02-26T12:20:25.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 0x7fe7900c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7900c2c10 0x7fe7900c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe79015ac90 0x7fe79015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cc2e0 con 0x7fe7900c2830 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cc160 con 0x7fe7900c2c10 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe797ded640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe790166ba0 con 0x7fe79015ac90 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 0x7fe7900c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 0x7fe7900c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:43976/0 (socket says 172.21.15.113:43976) 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 -- 172.21.15.113:0/1673905377 learned_addr learned my addr 172.21.15.113:0/1673905377 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 -- 172.21.15.113:0/1673905377 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe79015ac90 msgr2=0x7fe79015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe79015ac90 0x7fe79015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 -- 172.21.15.113:0/1673905377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7900c2c10 msgr2=0x7fe7900c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7900c2c10 0x7fe7900c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.091+0000 7fe795b89640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79015b9c0 con 0x7fe7900c2830 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe795b89640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 0x7fe7900c3a10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe78c007290 tx=0x7fe78c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00f960 con 0x7fe7900c2830 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c018070 con 0x7fe7900c2830 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790156e30 con 0x7fe7900c2830 2024-02-26T12:20:25.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00fd40 con 0x7fe7900c2830 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.092+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7901573f0 con 0x7fe7900c2830 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.093+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe79015bca0 con 0x7fe7900c2830 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.093+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe78c01d460 con 0x7fe7900c2830 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe7867fc640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe77406b500 0x7fe77406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe78c08a180 con 0x7fe7900c2830 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe795388640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe77406b500 0x7fe77406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe7867fc640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7fe774073700 0x7fe774075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe78c017ec0 con 0x7fe774073700 2024-02-26T12:20:25.087 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe78c091050 con 0x7fe7900c2830 2024-02-26T12:20:25.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe79638a640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7fe774073700 0x7fe774075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe795388640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe77406b500 0x7fe77406d9c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7800079a0 tx=0x7fe780009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.094+0000 7fe79638a640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7fe774073700 0x7fe774075b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.088 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.095+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== osd.2 v2:172.21.15.113:6816/1378425100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe78c017ec0 con 0x7fe774073700 2024-02-26T12:20:25.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 --> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe7900cd160 con 0x7fe774073700 2024-02-26T12:20:25.093 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe7867fc640 1 -- 172.21.15.113:0/1673905377 <== osd.2 v2:172.21.15.113:6816/1378425100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe7900cd160 con 0x7fe774073700 2024-02-26T12:20:25.093 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:25.094 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:25.094 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:25.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7fe774073700 msgr2=0x7fe774075b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6816/1378425100,v1:172.21.15.113:6817/1378425100] conn(0x7fe774073700 0x7fe774075b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.095 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe77406b500 msgr2=0x7fe77406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe77406b500 0x7fe77406d9c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7800079a0 tx=0x7fe780009040 comp rx=0 tx=0).stop 2024-02-26T12:20:25.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 msgr2=0x7fe7900c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 --2- 172.21.15.113:0/1673905377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7900c2830 0x7fe7900c3a10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe78c007290 tx=0x7fe78c007750 comp rx=0 tx=0).stop 2024-02-26T12:20:25.096 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe79638a640 1 -- 172.21.15.113:0/1673905377 reap_dead start 2024-02-26T12:20:25.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 shutdown_connections 2024-02-26T12:20:25.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 >> 172.21.15.113:0/1673905377 conn(0x7fe7900cc990 msgr2=0x7fe7900afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.099 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 shutdown_connections 2024-02-26T12:20:25.100 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.108+0000 7fe797ded640 1 -- 172.21.15.113:0/1673905377 wait complete. 2024-02-26T12:20:25.104 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-26T12:20:25.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.221+0000 7fba9e636640 1 Processor -- start 2024-02-26T12:20:25.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.221+0000 7fba9e636640 1 -- start start 2024-02-26T12:20:25.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9e636640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 0x7fba980cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9e636640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba980cfbf0 0x7fba980ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.207 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9e636640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980d0070 con 0x7fba980ceea0 2024-02-26T12:20:25.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9e636640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9815d060 con 0x7fba980cfbf0 2024-02-26T12:20:25.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9e636640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815f6e0 con 0x7fba98145330 2024-02-26T12:20:25.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9cbd3640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fba980ceea0 0x7fba98071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:39268/0 (socket says 172.21.15.113:39268) 2024-02-26T12:20:25.208 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba9cbd3640 1 -- 172.21.15.113:0/3235186285 learned_addr learned my addr 172.21.15.113:0/3235186285 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310328258 0 0) 0x7fba980d0070 con 0x7fba980ceea0 2024-02-26T12:20:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba80003520 con 0x7fba980ceea0 2024-02-26T12:20:25.213 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150672003 0 0) 0x7fba80003520 con 0x7fba980ceea0 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 msgr2=0x7fba980cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 0x7fba980cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 >> v2:172.21.15.152:3300/0 conn(0x7fba980cfbf0 msgr2=0x7fba980ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba977fe640 1 --2- 172.21.15.113:0/3235186285 >> v2:172.21.15.152:3300/0 conn(0x7fba980cfbf0 0x7fba980ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 --2- 172.21.15.113:0/3235186285 >> v2:172.21.15.152:3300/0 conn(0x7fba980cfbf0 0x7fba980ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.222+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9815f9c0 con 0x7fba980ceea0 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fba900019f0 con 0x7fba980ceea0 2024-02-26T12:20:25.214 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 >> v1:172.21.15.152:6789/0 conn(0x7fba980ceea0 legacy=0x7fba98071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 0x7fba800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba800040c0 0x7fba80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba80004d90 0x7fba80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815f6e0 con 0x7fba80004d90 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8000bc00 con 0x7fba800040c0 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8000be00 con 0x7fba98145330 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba977fe640 1 --2- 172.21.15.113:0/3235186285 >> v2:172.21.15.152:3300/0 conn(0x7fba980cfbf0 0x7fba980ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba80004d90 0x7fba80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.215 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba977fe640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba800040c0 0x7fba80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 -- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 msgr2=0x7fba800039b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba98145330 0x7fba800039b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 -- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba800040c0 msgr2=0x7fba80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba800040c0 0x7fba80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.223+0000 7fba9cbd3640 1 -- 172.21.15.113:0/3235186285 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80003520 con 0x7fba80004d90 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9cbd3640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba80004d90 0x7fba80005210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba9000a920 tx=0x7fba80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10ea88dce8077eb server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000a4c0 con 0x7fba80004d90 2024-02-26T12:20:25.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90034630 con 0x7fba80004d90 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba96ffd640 1 -- 172.21.15.113:0/3235186285 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90034aa0 con 0x7fba80004d90 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9e636640 1 -- 172.21.15.113:0/3235186285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba80004d90 msgr2=0x7fba80005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9e636640 1 --2- 172.21.15.113:0/3235186285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba80004d90 0x7fba80005210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba9000a920 tx=0x7fba80005830 comp rx=0 tx=0).stop 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9cbd3640 1 -- 172.21.15.113:0/3235186285 reap_dead start 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9e636640 1 -- 172.21.15.113:0/3235186285 shutdown_connections 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.224+0000 7fba9e636640 1 -- 172.21.15.113:0/3235186285 >> 172.21.15.113:0/3235186285 conn(0x7fba9806ab50 msgr2=0x7fba9806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.225+0000 7fba9e636640 1 -- 172.21.15.113:0/3235186285 shutdown_connections 2024-02-26T12:20:25.217 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.225+0000 7fba9e636640 1 -- 172.21.15.113:0/3235186285 wait complete. 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 Processor -- start 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 -- start start 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba80004d90 0x7fba980aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980a84a0 0x7fba980a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980cf330 con 0x7fba981f1390 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815ff80 con 0x7fba980a84a0 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.226+0000 7fba9e636640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba98145710 con 0x7fba80004d90 2024-02-26T12:20:25.218 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44002/0 (socket says 172.21.15.113:44002) 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 -- 172.21.15.113:0/2563096927 learned_addr learned my addr 172.21.15.113:0/2563096927 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba9cbd3640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980a84a0 0x7fba980a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba97fff640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba80004d90 0x7fba980aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 -- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba80004d90 msgr2=0x7fba980aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba80004d90 0x7fba980aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 -- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980a84a0 msgr2=0x7fba980a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.219 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980a84a0 0x7fba980a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 -- 172.21.15.113:0/2563096927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba981f1bf0 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba977fe640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00fa20 tx=0x7fba8c00fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00dd30 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c013440 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba981f1ed0 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c013830 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.227+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9813f8a0 con 0x7fba981f1390 2024-02-26T12:20:25.220 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.228+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980b02b0 con 0x7fba981f1390 2024-02-26T12:20:25.221 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.229+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba8c0139d0 con 0x7fba981f1390 2024-02-26T12:20:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.229+0000 7fba94ff9640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 0x7fba8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.229+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba8c08abe0 con 0x7fba981f1390 2024-02-26T12:20:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.229+0000 7fba97fff640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 0x7fba8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.230+0000 7fba97fff640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 0x7fba8406d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba88006fd0 tx=0x7fba880090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.222 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.234+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba8c017030 con 0x7fba981f1390 2024-02-26T12:20:25.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.405+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fba98074a50 con 0x7fba8406b4d0 2024-02-26T12:20:25.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.406+0000 7fba94ff9640 1 -- 172.21.15.113:0/2563096927 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fba98074a50 con 0x7fba8406b4d0 2024-02-26T12:20:25.391 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 2 to deep-scrub 2024-02-26T12:20:25.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 msgr2=0x7fba8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 0x7fba8406d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba88006fd0 tx=0x7fba880090e0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 msgr2=0x7fba9813f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00fa20 tx=0x7fba8c00fee0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.395 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 shutdown_connections 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fba8406b4d0 0x7fba8406d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980a84a0 0x7fba980a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba981f1390 0x7fba9813f360 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 --2- 172.21.15.113:0/2563096927 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba80004d90 0x7fba980aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 >> 172.21.15.113:0/2563096927 conn(0x7fba9806ab50 msgr2=0x7fba9815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 shutdown_connections 2024-02-26T12:20:25.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.408+0000 7fba9e636640 1 -- 172.21.15.113:0/2563096927 wait complete. 2024-02-26T12:20:25.404 INFO:tasks.ceph:Scrubbing osd.3 2024-02-26T12:20:25.404 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:25.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.523+0000 7f7d6971e640 1 Processor -- start 2024-02-26T12:20:25.512 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.523+0000 7f7d6971e640 1 -- start start 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d6971e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d640b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d6971e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d640ceef0 0x7f7d640d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d6971e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d640d2570 con 0x7f7d640d3610 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d6971e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6415e0c0 con 0x7f7d640ceef0 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d6971e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640d2850 con 0x7f7d6415dce0 2024-02-26T12:20:25.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d627fc640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7d640d3610 0x7f7d640ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45022/0 (socket says 172.21.15.113:45022) 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d627fc640 1 -- 172.21.15.113:0/2285333056 learned_addr learned my addr 172.21.15.113:0/2285333056 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862798467 0 0) 0x7f7d640d2570 con 0x7f7d640d3610 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d637fe640 1 --2- 172.21.15.113:0/2285333056 >> v2:172.21.15.152:3300/0 conn(0x7f7d640ceef0 0x7f7d640d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d4c003520 con 0x7f7d640d3610 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.524+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d640b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2822136059 0 0) 0x7f7d4c003520 con 0x7f7d640d3610 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 msgr2=0x7f7d640b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d640b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 >> v2:172.21.15.152:3300/0 conn(0x7f7d640ceef0 msgr2=0x7f7d640d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 --2- 172.21.15.113:0/2285333056 >> v2:172.21.15.152:3300/0 conn(0x7f7d640ceef0 0x7f7d640d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d640d2b30 con 0x7f7d640d3610 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f7d58001670 con 0x7f7d640d3610 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 >> v1:172.21.15.113:6789/0 conn(0x7f7d640d3610 legacy=0x7f7d640ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d4c0039b0 0x7f7d4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c004d40 0x7f7d4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6415e0c0 con 0x7f7d4c0039b0 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640d2850 con 0x7f7d4c004d40 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c00b9c0 con 0x7f7d6415dce0 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d4c0039b0 0x7f7d4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d627fc640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d637fe640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c004d40 0x7f7d4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 -- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 msgr2=0x7f7d4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415dce0 0x7f7d4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 -- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c004d40 msgr2=0x7f7d4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c004d40 0x7f7d4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d62ffd640 1 -- 172.21.15.113:0/2285333056 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c003520 con 0x7f7d4c0039b0 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.525+0000 7f7d637fe640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c004d40 0x7f7d4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d4c0039b0 0x7f7d4c003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009fc0 tx=0x7f7d4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601464fbb5938dff server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54039070 con 0x7f7d4c0039b0 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5402cc20 con 0x7f7d4c0039b0 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d61ffb640 1 -- 172.21.15.113:0/2285333056 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54009c10 con 0x7f7d4c0039b0 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d6971e640 1 -- 172.21.15.113:0/2285333056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d4c0039b0 msgr2=0x7f7d4c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d6971e640 1 --2- 172.21.15.113:0/2285333056 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d4c0039b0 0x7f7d4c003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009fc0 tx=0x7f7d4c005830 comp rx=0 tx=0).stop 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d637fe640 1 -- 172.21.15.113:0/2285333056 reap_dead start 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d6971e640 1 -- 172.21.15.113:0/2285333056 shutdown_connections 2024-02-26T12:20:25.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.526+0000 7f7d6971e640 1 -- 172.21.15.113:0/2285333056 >> 172.21.15.113:0/2285333056 conn(0x7f7d640b5620 msgr2=0x7f7d640b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.527+0000 7f7d6971e640 1 -- 172.21.15.113:0/2285333056 shutdown_connections 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.527+0000 7f7d6971e640 1 -- 172.21.15.113:0/2285333056 wait complete. 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.528+0000 7f7d6971e640 1 Processor -- start 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.528+0000 7f7d6971e640 1 -- start start 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0039b0 0x7f7d64150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 0x7f7d6415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415bb00 0x7f7d641526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b9600 con 0x7f7d6414f0f0 2024-02-26T12:20:25.525 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640d30f0 con 0x7f7d4c0039b0 2024-02-26T12:20:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d640b9780 con 0x7f7d6415bb00 2024-02-26T12:20:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 0x7f7d6415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 0x7f7d6415b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44022/0 (socket says 172.21.15.113:44022) 2024-02-26T12:20:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 -- 172.21.15.113:0/1745050922 learned_addr learned my addr 172.21.15.113:0/1745050922 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:25.526 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0039b0 0x7f7d64150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d637fe640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415bb00 0x7f7d641526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 -- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415bb00 msgr2=0x7f7d641526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d6415bb00 0x7f7d641526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 -- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0039b0 msgr2=0x7f7d64150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d4c0039b0 0x7f7d64150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d641513a0 con 0x7f7d6414f0f0 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d627fc640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 0x7f7d6415b5c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7d58007310 tx=0x7f7d580077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800fa80 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58018070 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d64160360 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800fe80 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.529+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d64160920 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.530+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d64074a50 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d5801d460 con 0x7f7d6414f0f0 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7d5006b4d0 0x7f7d5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d5808a1e0 con 0x7f7d6414f0f0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7d5006b4d0 0x7f7d5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7f7d50073670 0x7f7d50075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d58009e50 con 0x7f7d50073670 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.531+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d58091050 con 0x7f7d6414f0f0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.532+0000 7f7d637fe640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7f7d50073670 0x7f7d50075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.532+0000 7f7d62ffd640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7d5006b4d0 0x7f7d5006d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.532+0000 7f7d637fe640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7f7d50073670 0x7f7d50075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.532+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== osd.3 v2:172.21.15.113:6800/3789965285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7d58009e50 con 0x7f7d50073670 2024-02-26T12:20:25.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.545+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 --> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7d6415bee0 con 0x7f7d50073670 2024-02-26T12:20:25.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d4b7fe640 1 -- 172.21.15.113:0/1745050922 <== osd.3 v2:172.21.15.113:6800/3789965285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7d6415bee0 con 0x7f7d50073670 2024-02-26T12:20:25.531 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:25.531 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:25.531 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:25.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7f7d50073670 msgr2=0x7f7d50075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.532 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6800/3789965285,v1:172.21.15.113:6801/3789965285] conn(0x7f7d50073670 0x7f7d50075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7d5006b4d0 msgr2=0x7f7d5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f7d5006b4d0 0x7f7d5006d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d54036000 tx=0x7f7d5402e000 comp rx=0 tx=0).stop 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 msgr2=0x7f7d6415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 --2- 172.21.15.113:0/1745050922 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d6414f0f0 0x7f7d6415b5c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7d58007310 tx=0x7f7d580077d0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d637fe640 1 -- 172.21.15.113:0/1745050922 reap_dead start 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 shutdown_connections 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 >> 172.21.15.113:0/1745050922 conn(0x7f7d640b5620 msgr2=0x7f7d640b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.533 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 shutdown_connections 2024-02-26T12:20:25.534 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.546+0000 7f7d6971e640 1 -- 172.21.15.113:0/1745050922 wait complete. 2024-02-26T12:20:25.541 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-26T12:20:25.643 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.658+0000 7f208f11e640 1 Processor -- start 2024-02-26T12:20:25.644 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.658+0000 7f208f11e640 1 -- start start 2024-02-26T12:20:25.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208f11e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 0x7f208806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208f11e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f208806fd40 0x7f208806afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.645 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208f11e640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20880b5e00 con 0x7f20880b5840 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208f11e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208806ab50 con 0x7f208806fd40 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208f11e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208815cd60 con 0x7f208815b9b0 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f2087fff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f20880b5840 0x7f208806f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45034/0 (socket says 172.21.15.113:45034) 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f2087fff640 1 -- 172.21.15.113:0/2979331938 learned_addr learned my addr 172.21.15.113:0/2979331938 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208d6bb640 1 --2- 172.21.15.113:0/2979331938 >> v2:172.21.15.113:3300/0 conn(0x7f208806fd40 0x7f208806afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208ceba640 1 --2- 172.21.15.113:0/2979331938 >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 0x7f208806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208d6bb640 1 -- 172.21.15.113:0/2979331938 >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 msgr2=0x7f208806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.646 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208d6bb640 1 --2- 172.21.15.113:0/2979331938 >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 0x7f208806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208d6bb640 1 -- 172.21.15.113:0/2979331938 >> v1:172.21.15.113:6789/0 conn(0x7f20880b5840 legacy=0x7f208806f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208d6bb640 1 -- 172.21.15.113:0/2979331938 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208815d040 con 0x7f208806fd40 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f20877fe640 1 -- 172.21.15.113:0/2979331938 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060972733 0 0) 0x7f20880b5e00 con 0x7f20880b5840 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.659+0000 7f208ceba640 1 --2- 172.21.15.113:0/2979331938 >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 0x7f208806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.660+0000 7f208d6bb640 1 --2- 172.21.15.113:0/2979331938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208806fd40 0x7f208806afe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f208002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836b7d49fe3167bd server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.660+0000 7f20877fe640 1 -- 172.21.15.113:0/2979331938 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080039070 con 0x7f208806fd40 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.660+0000 7f20877fe640 1 -- 172.21.15.113:0/2979331938 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208002cd00 con 0x7f208806fd40 2024-02-26T12:20:25.647 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.660+0000 7f20877fe640 1 -- 172.21.15.113:0/2979331938 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080034660 con 0x7f208806fd40 2024-02-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 -- 172.21.15.113:0/2979331938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208806fd40 msgr2=0x7f208806afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 --2- 172.21.15.113:0/2979331938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208806fd40 0x7f208806afe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f208002bf50 comp rx=0 tx=0).stop 2024-02-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 -- 172.21.15.113:0/2979331938 shutdown_connections 2024-02-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 --2- 172.21.15.113:0/2979331938 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208806fd40 0x7f208806afe0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.651 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 --2- 172.21.15.113:0/2979331938 >> v2:172.21.15.152:3300/0 conn(0x7f208815b9b0 0x7f208806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 -- 172.21.15.113:0/2979331938 >> 172.21.15.113:0/2979331938 conn(0x7f20880cc9a0 msgr2=0x7f20880ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 -- 172.21.15.113:0/2979331938 shutdown_connections 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.661+0000 7f208f11e640 1 -- 172.21.15.113:0/2979331938 wait complete. 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.662+0000 7f208f11e640 1 Processor -- start 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.662+0000 7f208f11e640 1 -- start start 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f208806fd40 0x7f20881f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 0x7f208815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.652 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208815bf10 con 0x7f208815b9b0 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208815bd90 con 0x7f208806fd40 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208f11e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208815c900 con 0x7f20880b5840 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44036/0 (socket says 172.21.15.113:44036) 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 -- 172.21.15.113:0/3493492505 learned_addr learned my addr 172.21.15.113:0/3493492505 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208ceba640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f208806fd40 0x7f20881f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.653 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f2087fff640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 0x7f208815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 -- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 msgr2=0x7f208815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 0x7f208815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 -- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f208806fd40 msgr2=0x7f20881f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f208806fd40 0x7f20881f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 -- 172.21.15.113:0/3493492505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208815e380 con 0x7f208815b9b0 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f2087fff640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 0x7f208815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f208d6bb640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f2080004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.654 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080039050 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.663+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080045070 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.664+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20881f1a70 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.664+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208003e830 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.664+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208815a9c0 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.664+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088074a50 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.665+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f208003e9d0 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.665+0000 7f20857fa640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.665+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20800ad050 con 0x7f208815b9b0 2024-02-26T12:20:25.655 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.665+0000 7f208ceba640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.666+0000 7f208ceba640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 0x7f207406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2078006fd0 tx=0x7f2078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.656 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.670+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f208007c080 con 0x7f208815b9b0 2024-02-26T12:20:25.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.839+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f208815e660 con 0x7f207406b4d0 2024-02-26T12:20:25.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.840+0000 7f20857fa640 1 -- 172.21.15.113:0/3493492505 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f207800b140 con 0x7f207406b4d0 2024-02-26T12:20:25.825 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 3 to deep-scrub 2024-02-26T12:20:25.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 msgr2=0x7f207406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 0x7f207406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2078006fd0 tx=0x7f2078008040 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 msgr2=0x7f2088157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2080009d90 tx=0x7f2080004a40 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 shutdown_connections 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f207406b4d0 0x7f207406d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f208815b9b0 0x7f2088157b00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20880b5840 0x7f208815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 --2- 172.21.15.113:0/3493492505 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f208806fd40 0x7f20881f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 >> 172.21.15.113:0/3493492505 conn(0x7f20880cc9a0 msgr2=0x7f20880b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 shutdown_connections 2024-02-26T12:20:25.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.842+0000 7f208f11e640 1 -- 172.21.15.113:0/3493492505 wait complete. 2024-02-26T12:20:25.838 INFO:tasks.ceph:Scrubbing osd.4 2024-02-26T12:20:25.838 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:25.944 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.959+0000 7fed08f68640 1 Processor -- start 2024-02-26T12:20:25.945 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.959+0000 7fed08f68640 1 -- start start 2024-02-26T12:20:25.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed08f68640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 0x7fed040cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.946 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed08f68640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 0x7fed0415e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed08f68640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed040ce110 con 0x7fed040ce560 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed08f68640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed040b2570 con 0x7fed040aee00 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed08f68640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cd350 con 0x7fed040cba90 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed02d9d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 0x7fed0415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed0259c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 0x7fed040cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed01d9b640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fed040ce560 0x7fed040cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.113:39274/0 (socket says 172.21.15.113:39274) 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.960+0000 7fed01d9b640 1 -- 172.21.15.113:0/3310865584 learned_addr learned my addr 172.21.15.113:0/3310865584 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:25.947 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed02d9d640 1 -- 172.21.15.113:0/3310865584 >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 msgr2=0x7fed040cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:25.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed02d9d640 1 --2- 172.21.15.113:0/3310865584 >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 0x7fed040cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed02d9d640 1 -- 172.21.15.113:0/3310865584 >> v1:172.21.15.152:6789/0 conn(0x7fed040ce560 legacy=0x7fed040cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed02d9d640 1 -- 172.21.15.113:0/3310865584 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040cd630 con 0x7fed040cba90 2024-02-26T12:20:25.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed0259c640 1 --2- 172.21.15.113:0/3310865584 >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 0x7fed040cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:25.948 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.961+0000 7fed02d9d640 1 --2- 172.21.15.113:0/3310865584 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 0x7fed0415e930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009d90 tx=0x7fecfc02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23a93949e76fe25 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed0159a640 1 -- 172.21.15.113:0/3310865584 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc039070 con 0x7fed040cba90 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed0159a640 1 -- 172.21.15.113:0/3310865584 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc02cb30 con 0x7fed040cba90 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed0159a640 1 -- 172.21.15.113:0/3310865584 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc034440 con 0x7fed040cba90 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 -- 172.21.15.113:0/3310865584 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 msgr2=0x7fed0415e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 --2- 172.21.15.113:0/3310865584 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 0x7fed0415e930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009d90 tx=0x7fecfc02bd80 comp rx=0 tx=0).stop 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 -- 172.21.15.113:0/3310865584 shutdown_connections 2024-02-26T12:20:25.953 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 --2- 172.21.15.113:0/3310865584 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040cba90 0x7fed0415e930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 --2- 172.21.15.113:0/3310865584 >> v2:172.21.15.152:3300/0 conn(0x7fed040aee00 0x7fed040cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 -- 172.21.15.113:0/3310865584 >> 172.21.15.113:0/3310865584 conn(0x7fed040cf6e0 msgr2=0x7fed040cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 -- 172.21.15.113:0/3310865584 shutdown_connections 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.962+0000 7fed08f68640 1 -- 172.21.15.113:0/3310865584 wait complete. 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 Processor -- start 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 -- start start 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 0x7fed040b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.954 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed040cba90 0x7fed040c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040ce560 0x7fed04155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cf350 con 0x7fed040aee00 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cdbf0 con 0x7fed040cba90 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed08f68640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040c9dc0 con 0x7fed040ce560 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed0259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 0x7fed040b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed0259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 0x7fed040b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44046/0 (socket says 172.21.15.113:44046) 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.964+0000 7fed0259c640 1 -- 172.21.15.113:0/114953934 learned_addr learned my addr 172.21.15.113:0/114953934 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:25.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed02d9d640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040ce560 0x7fed04155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed01d9b640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed040cba90 0x7fed040c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 -- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040ce560 msgr2=0x7fed04155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040ce560 0x7fed04155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 -- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed040cba90 msgr2=0x7fed040c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed040cba90 0x7fed040c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040c4590 con 0x7fed040aee00 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed02d9d640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fed040ce560 0x7fed04155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:25.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed0259c640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 0x7fed040b3d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e960 tx=0x7fecf400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4017070 con 0x7fed040aee00 2024-02-26T12:20:25.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400ca00 con 0x7fed040aee00 2024-02-26T12:20:25.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf400cdd0 con 0x7fed040aee00 2024-02-26T12:20:25.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed040c4870 con 0x7fed040aee00 2024-02-26T12:20:25.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.965+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed040c4e30 con 0x7fed040aee00 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.966+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed04074a50 con 0x7fed040aee00 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.966+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fecf401a070 con 0x7fed040aee00 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fecf2ffd640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fece406b4d0 0x7fece406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecf408a590 con 0x7fed040aee00 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fed01d9b640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fece406b4d0 0x7fece406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fecf2ffd640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7fece40736d0 0x7fece4075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecf401ae50 con 0x7fece40736d0 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf4091050 con 0x7fed040aee00 2024-02-26T12:20:25.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fed02d9d640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7fece40736d0 0x7fece4075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:25.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.967+0000 7fed01d9b640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fece406b4d0 0x7fece406d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed040d05e0 tx=0x7fecf8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.968+0000 7fed02d9d640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7fece40736d0 0x7fece4075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:25.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.969+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== osd.4 v2:172.21.15.152:6816/1514413955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fecf401ae50 con 0x7fece40736d0 2024-02-26T12:20:25.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.981+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 --> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fed0406f500 con 0x7fece40736d0 2024-02-26T12:20:25.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fecf2ffd640 1 -- 172.21.15.113:0/114953934 <== osd.4 v2:172.21.15.152:6816/1514413955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fed0406f500 con 0x7fece40736d0 2024-02-26T12:20:25.967 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:25.967 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:25.968 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7fece40736d0 msgr2=0x7fece4075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.152:6816/1514413955,v1:172.21.15.152:6817/1514413955] conn(0x7fece40736d0 0x7fece4075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fece406b4d0 msgr2=0x7fece406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fece406b4d0 0x7fece406d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed040d05e0 tx=0x7fecf8009040 comp rx=0 tx=0).stop 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 msgr2=0x7fed040b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:25.969 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 --2- 172.21.15.113:0/114953934 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed040aee00 0x7fed040b3d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e960 tx=0x7fecf400ee20 comp rx=0 tx=0).stop 2024-02-26T12:20:25.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed02d9d640 1 -- 172.21.15.113:0/114953934 reap_dead start 2024-02-26T12:20:25.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 shutdown_connections 2024-02-26T12:20:25.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.982+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 >> 172.21.15.113:0/114953934 conn(0x7fed040cf6e0 msgr2=0x7fed040b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:25.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.983+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 shutdown_connections 2024-02-26T12:20:25.970 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:25.983+0000 7fed08f68640 1 -- 172.21.15.113:0/114953934 wait complete. 2024-02-26T12:20:25.978 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-26T12:20:26.079 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.094+0000 7f62c8c2d640 1 Processor -- start 2024-02-26T12:20:26.080 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.094+0000 7f62c8c2d640 1 -- start start 2024-02-26T12:20:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c8c2d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f62c415aa60 0x7f62c40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.082 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c8c2d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415ae40 0x7f62c40b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c8c2d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40ce1d0 con 0x7f62c406d2f0 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c8c2d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40ce4b0 con 0x7f62c415aa60 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c8c2d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40ce790 con 0x7f62c415ae40 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c259c640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f62c415aa60 0x7f62c40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c2d9d640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f62c406d2f0 0x7f62c40b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45040/0 (socket says 172.21.15.113:45040) 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c2d9d640 1 -- 172.21.15.113:0/1457271251 learned_addr learned my addr 172.21.15.113:0/1457271251 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:26.083 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c1d9b640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415ae40 0x7f62c40b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c259c640 1 -- 172.21.15.113:0/1457271251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415ae40 msgr2=0x7f62c40b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c259c640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415ae40 0x7f62c40b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c259c640 1 -- 172.21.15.113:0/1457271251 >> v1:172.21.15.113:6789/0 conn(0x7f62c406d2f0 legacy=0x7f62c40b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.096+0000 7f62c259c640 1 -- 172.21.15.113:0/1457271251 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40cea70 con 0x7f62c415aa60 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.095+0000 7f62c159a640 1 -- 172.21.15.113:0/1457271251 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848893255 0 0) 0x7f62c40ce1d0 con 0x7f62c406d2f0 2024-02-26T12:20:26.084 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.096+0000 7f62c259c640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c415aa60 0x7f62c40cd880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f62b400bfa0 tx=0x7f62b402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1490fec26755 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.096+0000 7f62c159a640 1 -- 172.21.15.113:0/1457271251 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b402ea40 con 0x7f62c415aa60 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.096+0000 7f62c159a640 1 -- 172.21.15.113:0/1457271251 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b402ebe0 con 0x7f62c415aa60 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.096+0000 7f62c159a640 1 -- 172.21.15.113:0/1457271251 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4009540 con 0x7f62c415aa60 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 -- 172.21.15.113:0/1457271251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c415aa60 msgr2=0x7f62c40cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c415aa60 0x7f62c40cd880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f62b400bfa0 tx=0x7f62b402e0a0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 -- 172.21.15.113:0/1457271251 shutdown_connections 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415ae40 0x7f62c40b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.085 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/1457271251 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c415aa60 0x7f62c40cd880 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 -- 172.21.15.113:0/1457271251 >> 172.21.15.113:0/1457271251 conn(0x7f62c406ab50 msgr2=0x7f62c406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 -- 172.21.15.113:0/1457271251 shutdown_connections 2024-02-26T12:20:26.086 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.097+0000 7f62c8c2d640 1 -- 172.21.15.113:0/1457271251 wait complete. 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.098+0000 7f62c8c2d640 1 Processor -- start 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.098+0000 7f62c8c2d640 1 -- start start 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415aa60 0x7f62c415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62c415ae40 0x7f62c415c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cdf40 con 0x7f62c406d2f0 2024-02-26T12:20:26.089 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40cddc0 con 0x7f62c415ae40 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c8c2d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40b46c0 con 0x7f62c415aa60 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44076/0 (socket says 172.21.15.113:44076) 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 -- 172.21.15.113:0/3347797362 learned_addr learned my addr 172.21.15.113:0/3347797362 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 -- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415aa60 msgr2=0x7f62c415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415aa60 0x7f62c415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 -- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62c415ae40 msgr2=0x7f62c415c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62c415ae40 0x7f62c415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.090 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.099+0000 7f62c259c640 1 -- 172.21.15.113:0/3347797362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40a8640 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62c259c640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62b4038040 tx=0x7f62b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4045030 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4009e40 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c40a8920 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400b660 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.100+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c40a8ee0 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.101+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4074a50 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.101+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f62b4048070 con 0x7f62c406d2f0 2024-02-26T12:20:26.091 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.102+0000 7f62b2ffd640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 0x7f62a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.102+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62b40aebd0 con 0x7f62c406d2f0 2024-02-26T12:20:26.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.102+0000 7f62c1d9b640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 0x7f62a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.102+0000 7f62c1d9b640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 0x7f62a406d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.092 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.106+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f62b407dae0 con 0x7f62c406d2f0 2024-02-26T12:20:26.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.276+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f62c406e4c0 con 0x7f62a406b4d0 2024-02-26T12:20:26.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.277+0000 7f62b2ffd640 1 -- 172.21.15.113:0/3347797362 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62c406e4c0 con 0x7f62a406b4d0 2024-02-26T12:20:26.262 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 4 to deep-scrub 2024-02-26T12:20:26.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 msgr2=0x7f62a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 0x7f62a406d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62b8006fd0 tx=0x7f62b8008040 comp rx=0 tx=0).stop 2024-02-26T12:20:26.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 msgr2=0x7f62c414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62b4038040 tx=0x7f62b4004a40 comp rx=0 tx=0).stop 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 shutdown_connections 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f62a406b4d0 0x7f62a406d990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62c415ae40 0x7f62c415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f62c415aa60 0x7f62c415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 --2- 172.21.15.113:0/3347797362 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62c406d2f0 0x7f62c414a280 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.278+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 >> 172.21.15.113:0/3347797362 conn(0x7f62c406ab50 msgr2=0x7f62c40cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.279+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 shutdown_connections 2024-02-26T12:20:26.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.279+0000 7f62c8c2d640 1 -- 172.21.15.113:0/3347797362 wait complete. 2024-02-26T12:20:26.274 INFO:tasks.ceph:Scrubbing osd.5 2024-02-26T12:20:26.275 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:26.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.395+0000 7f940eb1e640 1 Processor -- start 2024-02-26T12:20:26.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.395+0000 7f940eb1e640 1 -- start start 2024-02-26T12:20:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940eb1e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f94080aee00 0x7f94080cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940eb1e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f94080cba90 0x7f940815e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940eb1e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94080ce110 con 0x7f94080ce560 2024-02-26T12:20:26.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940eb1e640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080b2570 con 0x7f94080aee00 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940eb1e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080cd350 con 0x7f94080cba90 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f94080aee00 0x7f94080cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f94080aee00 0x7f94080cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44082/0 (socket says 172.21.15.113:44082) 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 -- 172.21.15.113:0/3989060379 learned_addr learned my addr 172.21.15.113:0/3989060379 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940d0bb640 1 --2- 172.21.15.113:0/3989060379 >> v2:172.21.15.152:3300/0 conn(0x7f94080cba90 0x7f940815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 -- 172.21.15.113:0/3989060379 >> v2:172.21.15.152:3300/0 conn(0x7f94080cba90 msgr2=0x7f940815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 --2- 172.21.15.113:0/3989060379 >> v2:172.21.15.152:3300/0 conn(0x7f94080cba90 0x7f940815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 -- 172.21.15.113:0/3989060379 >> v1:172.21.15.152:6789/0 conn(0x7f94080ce560 legacy=0x7f94080cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.396+0000 7f940c8ba640 1 -- 172.21.15.113:0/3989060379 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080cd630 con 0x7f94080aee00 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.397+0000 7f940c8ba640 1 --2- 172.21.15.113:0/3989060379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080aee00 0x7f94080cecc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9408070c20 tx=0x7f940402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769429bc18310638 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.397+0000 7f93ff7fe640 1 -- 172.21.15.113:0/3989060379 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404035020 con 0x7f94080aee00 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.397+0000 7f93ff7fe640 1 -- 172.21.15.113:0/3989060379 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404031870 con 0x7f94080aee00 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.397+0000 7f93ff7fe640 1 -- 172.21.15.113:0/3989060379 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404031c40 con 0x7f94080aee00 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 -- 172.21.15.113:0/3989060379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080aee00 msgr2=0x7f94080cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3989060379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080aee00 0x7f94080cecc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9408070c20 tx=0x7f940402b910 comp rx=0 tx=0).stop 2024-02-26T12:20:26.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 -- 172.21.15.113:0/3989060379 shutdown_connections 2024-02-26T12:20:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3989060379 >> v2:172.21.15.152:3300/0 conn(0x7f94080cba90 0x7f940815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3989060379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080aee00 0x7f94080cecc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 -- 172.21.15.113:0/3989060379 >> 172.21.15.113:0/3989060379 conn(0x7f94080cf6e0 msgr2=0x7f94080cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 -- 172.21.15.113:0/3989060379 shutdown_connections 2024-02-26T12:20:26.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.398+0000 7f940eb1e640 1 -- 172.21.15.113:0/3989060379 wait complete. 2024-02-26T12:20:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.399+0000 7f940eb1e640 1 Processor -- start 2024-02-26T12:20:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.399+0000 7f940eb1e640 1 -- start start 2024-02-26T12:20:26.389 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94080aee00 0x7f94081577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94080cba90 0x7f94080acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 0x7f94081f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080cf350 con 0x7f94080ce560 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080cdbf0 con 0x7f94080cba90 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080c9dc0 con 0x7f94080aee00 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 0x7f94081f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 0x7f94081f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44092/0 (socket says 172.21.15.113:44092) 2024-02-26T12:20:26.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 -- 172.21.15.113:0/3474795659 learned_addr learned my addr 172.21.15.113:0/3474795659 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940c8ba640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94080aee00 0x7f94081577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f93fffff640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94080cba90 0x7f94080acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 -- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94080aee00 msgr2=0x7f94081577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94080aee00 0x7f94081577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 -- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94080cba90 msgr2=0x7f94080acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94080cba90 0x7f94080acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94081f8440 con 0x7f94080ce560 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940d0bb640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 0x7f94081f75f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f940000efc0 tx=0x7f940000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400018020 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400014480 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400014870 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94081f8160 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.400+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94080c7060 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.401+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9408074a50 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9400005d10 con 0x7f94080ce560 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f93f406b4d0 0x7f93f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f940008afb0 con 0x7f94080ce560 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f940c8ba640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f93f406b4d0 0x7f93f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7f93f4073670 0x7f93f4075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9400012e50 con 0x7f93f4073670 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.402+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9400092050 con 0x7f94080ce560 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.403+0000 7f93fffff640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7f93f4073670 0x7f93f4075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.403+0000 7f940c8ba640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f93f406b4d0 0x7f93f406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9404036000 tx=0x7f940403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.403+0000 7f93fffff640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7f93f4073670 0x7f93f4075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.393 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.404+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== osd.5 v2:172.21.15.152:6824/237296747 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9400012e50 con 0x7f93f4073670 2024-02-26T12:20:26.402 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.417+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 --> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94080c74a0 con 0x7f93f4073670 2024-02-26T12:20:26.403 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f93fd7fa640 1 -- 172.21.15.113:0/3474795659 <== osd.5 v2:172.21.15.152:6824/237296747 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94080c74a0 con 0x7f93f4073670 2024-02-26T12:20:26.403 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:26.404 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:26.404 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:26.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7f93f4073670 msgr2=0x7f93f4075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.152:6824/237296747,v1:172.21.15.152:6825/237296747] conn(0x7f93f4073670 0x7f93f4075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f93f406b4d0 msgr2=0x7f93f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f93f406b4d0 0x7f93f406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9404036000 tx=0x7f940403c040 comp rx=0 tx=0).stop 2024-02-26T12:20:26.405 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 msgr2=0x7f94081f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 --2- 172.21.15.113:0/3474795659 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f94080ce560 0x7f94081f75f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f940000efc0 tx=0x7f940000c490 comp rx=0 tx=0).stop 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940d0bb640 1 -- 172.21.15.113:0/3474795659 reap_dead start 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 shutdown_connections 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 >> 172.21.15.113:0/3474795659 conn(0x7f94080cf6e0 msgr2=0x7f94080741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 shutdown_connections 2024-02-26T12:20:26.406 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.418+0000 7f940eb1e640 1 -- 172.21.15.113:0/3474795659 wait complete. 2024-02-26T12:20:26.414 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-26T12:20:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.530+0000 7fb3657b4640 1 Processor -- start 2024-02-26T12:20:26.515 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.530+0000 7fb3657b4640 1 -- start start 2024-02-26T12:20:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb3657b4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb36015bd70 0x7fb3600cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb3657b4640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600b0e50 con 0x7fb3600b2900 2024-02-26T12:20:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb3657b4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36015c150 con 0x7fb360099a40 2024-02-26T12:20:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb3657b4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600cfbc0 con 0x7fb36015bd70 2024-02-26T12:20:26.519 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35f7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb3600b2900 0x7fb3600ccc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45044/0 (socket says 172.21.15.113:45044) 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35f7fe640 1 -- 172.21.15.113:0/861648211 learned_addr learned my addr 172.21.15.113:0/861648211 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513057962 0 0) 0x7fb3600b0e50 con 0x7fb3600b2900 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35effd640 1 --2- 172.21.15.113:0/861648211 >> v2:172.21.15.152:3300/0 conn(0x7fb36015bd70 0x7fb3600cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb348003520 con 0x7fb3600b2900 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424516802 0 0) 0x7fb348003520 con 0x7fb3600b2900 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 >> v2:172.21.15.152:3300/0 conn(0x7fb36015bd70 msgr2=0x7fb3600cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 --2- 172.21.15.113:0/861648211 >> v2:172.21.15.152:3300/0 conn(0x7fb36015bd70 0x7fb3600cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.520 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 >> v1:172.21.15.152:6789/0 conn(0x7fb360099a40 legacy=0x7fb3600cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36009ac10 con 0x7fb3600b2900 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7fb3580019f0 con 0x7fb3600b2900 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 >> v1:172.21.15.113:6789/0 conn(0x7fb3600b2900 legacy=0x7fb3600ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb348003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb348004800 0x7fb348004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3480051c0 0x7fb34800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600cfbc0 con 0x7fb3480051c0 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34800c160 con 0x7fb3480039b0 2024-02-26T12:20:26.521 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.531+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34800c360 con 0x7fb348004800 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb348003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35f7fe640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3480051c0 0x7fb34800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35e7fc640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb348004800 0x7fb348004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 -- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb348004800 msgr2=0x7fb348004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb348004800 0x7fb348004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 -- 172.21.15.113:0/861648211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3480051c0 msgr2=0x7fb34800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3480051c0 0x7fb34800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.522 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35effd640 1 -- 172.21.15.113:0/861648211 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb348003520 con 0x7fb3480039b0 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35f7fe640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3480051c0 0x7fb34800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.532+0000 7fb35f7fe640 1 -- 172.21.15.113:0/861648211 reap_dead start 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb35effd640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb348003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb350009ac0 tx=0x7fb348005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a5990f2731890 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350039070 con 0x7fb3480039b0 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35002c6b0 con 0x7fb3480039b0 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb35dffb640 1 -- 172.21.15.113:0/861648211 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350009690 con 0x7fb3480039b0 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 -- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 msgr2=0x7fb348003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.523 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb348003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb350009ac0 tx=0x7fb348005830 comp rx=0 tx=0).stop 2024-02-26T12:20:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 -- 172.21.15.113:0/861648211 shutdown_connections 2024-02-26T12:20:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 --2- 172.21.15.113:0/861648211 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb348003dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 -- 172.21.15.113:0/861648211 >> 172.21.15.113:0/861648211 conn(0x7fb3600b3390 msgr2=0x7fb3600b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 -- 172.21.15.113:0/861648211 shutdown_connections 2024-02-26T12:20:26.524 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.533+0000 7fb3657b4640 1 -- 172.21.15.113:0/861648211 wait complete. 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 Processor -- start 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 -- start start 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb36015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb36015d130 0x7fb36015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36009aef0 con 0x7fb360150310 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600b13d0 con 0x7fb3480039b0 2024-02-26T12:20:26.527 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb3657b4640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36009a8c0 con 0x7fb36015d130 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb35e7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.535+0000 7fb35e7fc640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44114/0 (socket says 172.21.15.113:44114) 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 -- 172.21.15.113:0/1715849010 learned_addr learned my addr 172.21.15.113:0/1715849010 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35effd640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb36015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35f7fe640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb36015d130 0x7fb36015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 -- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb36015d130 msgr2=0x7fb36015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.528 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb36015d130 0x7fb36015d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 -- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 msgr2=0x7fb36015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb36015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 -- 172.21.15.113:0/1715849010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3601f4930 con 0x7fb360150310 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb35e7fc640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb354001050 tx=0x7fb35400fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35401a070 con 0x7fb360150310 2024-02-26T12:20:26.529 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354005320 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3601f4c10 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354007270 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.536+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3601f51d0 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.537+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb360074a50 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.537+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb35401d070 con 0x7fb360150310 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.538+0000 7fb3477fe640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 0x7fb34c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.538+0000 7fb35effd640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 0x7fb34c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.530 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.538+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb354089980 con 0x7fb360150310 2024-02-26T12:20:26.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.538+0000 7fb35effd640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 0x7fb34c06d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb350036000 tx=0x7fb350030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.531 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.542+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb354058800 con 0x7fb360150310 2024-02-26T12:20:26.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.712+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3601f46e0 con 0x7fb34c06b4d0 2024-02-26T12:20:26.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.712+0000 7fb3477fe640 1 -- 172.21.15.113:0/1715849010 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3601f46e0 con 0x7fb34c06b4d0 2024-02-26T12:20:26.697 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 5 to deep-scrub 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 msgr2=0x7fb34c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 0x7fb34c06d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb350036000 tx=0x7fb350030000 comp rx=0 tx=0).stop 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 msgr2=0x7fb3600af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb354001050 tx=0x7fb35400fa50 comp rx=0 tx=0).stop 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 shutdown_connections 2024-02-26T12:20:26.700 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fb34c06b4d0 0x7fb34c06d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb36015d130 0x7fb36015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb360150310 0x7fb3600af750 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 --2- 172.21.15.113:0/1715849010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3480039b0 0x7fb36015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 >> 172.21.15.113:0/1715849010 conn(0x7fb3600b3390 msgr2=0x7fb36006f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 shutdown_connections 2024-02-26T12:20:26.701 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.714+0000 7fb3657b4640 1 -- 172.21.15.113:0/1715849010 wait complete. 2024-02-26T12:20:26.710 INFO:tasks.ceph:Scrubbing osd.6 2024-02-26T12:20:26.710 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:26.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.829+0000 7fe3a629d640 1 Processor -- start 2024-02-26T12:20:26.815 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.829+0000 7fe3a629d640 1 -- start start 2024-02-26T12:20:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe3a629d640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3a006ab50 0x7fe3a006af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.817 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe3a629d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe3a629d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a006b470 con 0x7fe3a00cc470 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe3a629d640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a0156800 con 0x7fe3a006ab50 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe3a629d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00cc9c0 con 0x7fe3a015ca80 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe39ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3a006ab50 0x7fe3a006af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe39ffff640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe3a006ab50 0x7fe3a006af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44120/0 (socket says 172.21.15.113:44120) 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.830+0000 7fe39ffff640 1 -- 172.21.15.113:0/3925326157 learned_addr learned my addr 172.21.15.113:0/3925326157 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe3a483a640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.818 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe39ffff640 1 -- 172.21.15.113:0/3925326157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 msgr2=0x7fe3a015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe39ffff640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe39ffff640 1 -- 172.21.15.113:0/3925326157 >> v1:172.21.15.152:6789/0 conn(0x7fe3a00cc470 legacy=0x7fe3a00cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe39ffff640 1 -- 172.21.15.113:0/3925326157 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00ccca0 con 0x7fe3a006ab50 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe3a483a640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.831+0000 7fe39ffff640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a006af30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4ec7037c9d0556 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe39effd640 1 -- 172.21.15.113:0/3925326157 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390035020 con 0x7fe3a006ab50 2024-02-26T12:20:26.819 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe39effd640 1 -- 172.21.15.113:0/3925326157 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390031640 con 0x7fe3a006ab50 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe39effd640 1 -- 172.21.15.113:0/3925326157 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39002d040 con 0x7fe3a006ab50 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 -- 172.21.15.113:0/3925326157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 msgr2=0x7fe3a006af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a006af30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe39002b8f0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 -- 172.21.15.113:0/3925326157 shutdown_connections 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3925326157 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a006af30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 -- 172.21.15.113:0/3925326157 >> 172.21.15.113:0/3925326157 conn(0x7fe3a0099a40 msgr2=0x7fe3a00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.820 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 -- 172.21.15.113:0/3925326157 shutdown_connections 2024-02-26T12:20:26.821 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.832+0000 7fe3a629d640 1 -- 172.21.15.113:0/3925326157 wait complete. 2024-02-26T12:20:26.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.833+0000 7fe3a629d640 1 Processor -- start 2024-02-26T12:20:26.824 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 -- start start 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a00b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a00cc470 0x7fe3a00ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00d16a0 con 0x7fe3a006ab50 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00cd260 con 0x7fe3a00cc470 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a629d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a015d690 con 0x7fe3a015ca80 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe39ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a00b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.825 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe39ffff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a00b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44132/0 (socket says 172.21.15.113:44132) 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe39ffff640 1 -- 172.21.15.113:0/3201664969 learned_addr learned my addr 172.21.15.113:0/3201664969 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe3a483a640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.834+0000 7fe39f7fe640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a00cc470 0x7fe3a00ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 -- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 msgr2=0x7fe3a015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3a015ca80 0x7fe3a015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 -- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a00cc470 msgr2=0x7fe3a00ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.826 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a00cc470 0x7fe3a00ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00cf3f0 con 0x7fe3a006ab50 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39f7fe640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3a00cc470 0x7fe3a00ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39ffff640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a00b2bd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe39002b930 tx=0x7fe3900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390040070 con 0x7fe3a006ab50 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390039c10 con 0x7fe3a006ab50 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390035040 con 0x7fe3a006ab50 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a00cf6c0 con 0x7fe3a006ab50 2024-02-26T12:20:26.827 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.835+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a00cfc80 con 0x7fe3a006ab50 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.836+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3a0068180 con 0x7fe3a006ab50 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.836+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe39004b060 con 0x7fe3a006ab50 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39cff9640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe38c06b4d0 0x7fe38c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3900abc00 con 0x7fe3a006ab50 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39f7fe640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe38c06b4d0 0x7fe38c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39cff9640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fe38c0736d0 0x7fe38c075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.828 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe38c0761a0 con 0x7fe38c0736d0 2024-02-26T12:20:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3900ae300 con 0x7fe3a006ab50 2024-02-26T12:20:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe39f7fe640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe38c06b4d0 0x7fe38c06d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe3a015bbe0 tx=0x7fe394009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.837+0000 7fe3a483a640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fe38c0736d0 0x7fe38c075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.838+0000 7fe3a483a640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fe38c0736d0 0x7fe38c075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.829 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.839+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== osd.6 v2:172.21.15.152:6800/4099407341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe38c0761a0 con 0x7fe38c0736d0 2024-02-26T12:20:26.836 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.851+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 --> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe3a0074a50 con 0x7fe38c0736d0 2024-02-26T12:20:26.837 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe39cff9640 1 -- 172.21.15.113:0/3201664969 <== osd.6 v2:172.21.15.152:6800/4099407341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe3a0074a50 con 0x7fe38c0736d0 2024-02-26T12:20:26.837 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:26.837 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:26.838 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fe38c0736d0 msgr2=0x7fe38c075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.152:6800/4099407341,v1:172.21.15.152:6801/4099407341] conn(0x7fe38c0736d0 0x7fe38c075af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe38c06b4d0 msgr2=0x7fe38c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fe38c06b4d0 0x7fe38c06d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe3a015bbe0 tx=0x7fe394009040 comp rx=0 tx=0).stop 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 msgr2=0x7fe3a00b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 --2- 172.21.15.113:0/3201664969 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3a006ab50 0x7fe3a00b2bd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe39002b930 tx=0x7fe3900046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.839 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a483a640 1 -- 172.21.15.113:0/3201664969 reap_dead start 2024-02-26T12:20:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 shutdown_connections 2024-02-26T12:20:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 >> 172.21.15.113:0/3201664969 conn(0x7fe3a0099a40 msgr2=0x7fe3a00ad620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 shutdown_connections 2024-02-26T12:20:26.840 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.852+0000 7fe3a629d640 1 -- 172.21.15.113:0/3201664969 wait complete. 2024-02-26T12:20:26.848 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-26T12:20:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.965+0000 7f3e7142d640 1 Processor -- start 2024-02-26T12:20:26.951 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e7142d640 1 -- start start 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e7142d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3e6c15aad0 0x7f3e6c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e7142d640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c0b2fd0 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e7142d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c0b32b0 con 0x7f3e6c15f0a0 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e7142d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b3870 con 0x7f3e6c15aad0 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e6b7fe640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f3e6c15ebf0 0x7f3e6c0cdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45048/0 (socket says 172.21.15.113:45048) 2024-02-26T12:20:26.955 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.966+0000 7f3e6b7fe640 1 -- 172.21.15.113:0/3984606677 learned_addr learned my addr 172.21.15.113:0/3984606677 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 --2- 172.21.15.113:0/3984606677 >> v2:172.21.15.152:3300/0 conn(0x7f3e6c15aad0 0x7f3e6c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217247233 0 0) 0x7f3e6c0b2fd0 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e54003520 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533246521 0 0) 0x7f3e6c0b32b0 con 0x7f3e6c15f0a0 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e6c0b2fd0 con 0x7f3e6c15f0a0 2024-02-26T12:20:26.956 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 125311948 0 0) 0x7f3e54003520 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 >> v2:172.21.15.152:3300/0 conn(0x7f3e6c15aad0 msgr2=0x7f3e6c0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 --2- 172.21.15.113:0/3984606677 >> v2:172.21.15.152:3300/0 conn(0x7f3e6c15aad0 0x7f3e6c0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 >> v1:172.21.15.152:6789/0 conn(0x7f3e6c15f0a0 legacy=0x7f3e6c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0b3590 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2280934148 0 0) 0x7f3e640019f0 con 0x7f3e6c15ebf0 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 >> v1:172.21.15.113:6789/0 conn(0x7f3e6c15ebf0 legacy=0x7f3e6c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e54003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.957 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e54004800 0x7f3e54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e540051c0 0x7f3e5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b3870 con 0x7f3e54003b90 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5400c090 con 0x7f3e540051c0 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5400c290 con 0x7f3e54004800 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e54003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6b7fe640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e540051c0 0x7f3e5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6a7fc640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e54004800 0x7f3e54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.958 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 -- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e54004800 msgr2=0x7f3e54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e54004800 0x7f3e54004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 -- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e540051c0 msgr2=0x7f3e5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e540051c0 0x7f3e5400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6b7fe640 1 -- 172.21.15.113:0/3984606677 reap_dead start 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6affd640 1 -- 172.21.15.113:0/3984606677 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54003520 con 0x7f3e54003b90 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.967+0000 7f3e6a7fc640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e54004800 0x7f3e54004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.968+0000 7f3e6affd640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e54003f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad1e09c269c667f server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.968+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c039070 con 0x7f3e54003b90 2024-02-26T12:20:26.959 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.968+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c02c6b0 con 0x7f3e54003b90 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.968+0000 7f3e69ffb640 1 -- 172.21.15.113:0/3984606677 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c009690 con 0x7f3e54003b90 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 -- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 msgr2=0x7f3e54003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e54003f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009ac0 tx=0x7f3e54005830 comp rx=0 tx=0).stop 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 -- 172.21.15.113:0/3984606677 shutdown_connections 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 --2- 172.21.15.113:0/3984606677 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e54003f90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 -- 172.21.15.113:0/3984606677 >> 172.21.15.113:0/3984606677 conn(0x7f3e6c06ab50 msgr2=0x7f3e6c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 -- 172.21.15.113:0/3984606677 shutdown_connections 2024-02-26T12:20:26.960 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.969+0000 7f3e7142d640 1 -- 172.21.15.113:0/3984606677 wait complete. 2024-02-26T12:20:26.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.970+0000 7f3e7142d640 1 Processor -- start 2024-02-26T12:20:26.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.970+0000 7f3e7142d640 1 -- start start 2024-02-26T12:20:26.963 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c15c550 0x7f3e6c14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 0x7f3e6c1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15e660 con 0x7f3e54003b90 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15e4e0 con 0x7f3e6c15da90 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e7142d640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15e7e0 con 0x7f3e6c15c550 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.964 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44152/0 (socket says 172.21.15.113:44152) 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 -- 172.21.15.113:0/4039571288 learned_addr learned my addr 172.21.15.113:0/4039571288 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6a7fc640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c15c550 0x7f3e6c14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6b7fe640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 0x7f3e6c1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 -- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c15c550 msgr2=0x7f3e6c14b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c15c550 0x7f3e6c14b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 -- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 msgr2=0x7f3e6c1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 0x7f3e6c1514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 -- 172.21.15.113:0/4039571288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c15b4b0 con 0x7f3e54003b90 2024-02-26T12:20:26.965 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6b7fe640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 0x7f3e6c1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e6affd640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c037040 tx=0x7f3e5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.971+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c042020 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.972+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c03a040 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.972+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c15b790 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.972+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c039070 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.972+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c15bd50 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.973+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c074a50 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.973+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e5c045020 con 0x7f3e54003b90 2024-02-26T12:20:26.966 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.973+0000 7f3e537fe640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 0x7f3e5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:26.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.973+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e5c0ab620 con 0x7f3e54003b90 2024-02-26T12:20:26.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.973+0000 7f3e6a7fc640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 0x7f3e5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:26.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.974+0000 7f3e6a7fc640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 0x7f3e5806d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c15cab0 tx=0x7f3e60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:26.967 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:26.978+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e5c04c070 con 0x7f3e54003b90 2024-02-26T12:20:27.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.151+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e6c0b1a20 con 0x7f3e5806b500 2024-02-26T12:20:27.136 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.151+0000 7f3e537fe640 1 -- 172.21.15.113:0/4039571288 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e6c0b1a20 con 0x7f3e5806b500 2024-02-26T12:20:27.136 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 6 to deep-scrub 2024-02-26T12:20:27.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 msgr2=0x7f3e5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.138 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 0x7f3e5806d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c15cab0 tx=0x7f3e60009040 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 msgr2=0x7f3e6c15aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c037040 tx=0x7f3e5c004730 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 shutdown_connections 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f3e5806b500 0x7f3e5806d9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e6c15da90 0x7f3e6c1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3e6c15c550 0x7f3e6c14b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 --2- 172.21.15.113:0/4039571288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3e54003b90 0x7f3e6c15aeb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 >> 172.21.15.113:0/4039571288 conn(0x7f3e6c06ab50 msgr2=0x7f3e6c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.139 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 shutdown_connections 2024-02-26T12:20:27.140 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.153+0000 7f3e7142d640 1 -- 172.21.15.113:0/4039571288 wait complete. 2024-02-26T12:20:27.149 INFO:tasks.ceph:Scrubbing osd.7 2024-02-26T12:20:27.149 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-26T12:20:27.252 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.267+0000 7f0676d75640 1 Processor -- start 2024-02-26T12:20:27.253 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.267+0000 7f0676d75640 1 -- start start 2024-02-26T12:20:27.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0676d75640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06700cf8c0 0x7f0670168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.254 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0676d75640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067015e0a0 con 0x7f06700c35a0 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0676d75640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700cacc0 con 0x7f067015dcc0 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0676d75640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700cc540 con 0x7f06700cf8c0 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0675312640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f06700cf8c0 0x7f0670168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f066ffff640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f06700c35a0 0x7f067006bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45050/0 (socket says 172.21.15.113:45050) 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f066ffff640 1 -- 172.21.15.113:0/2220967033 learned_addr learned my addr 172.21.15.113:0/2220967033 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0675312640 1 -- 172.21.15.113:0/2220967033 >> v1:172.21.15.152:6789/0 conn(0x7f067015dcc0 legacy=0x7f067006b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0675312640 1 -- 172.21.15.113:0/2220967033 >> v1:172.21.15.113:6789/0 conn(0x7f06700c35a0 legacy=0x7f067006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f0675312640 1 -- 172.21.15.113:0/2220967033 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700ca700 con 0x7f06700cf8c0 2024-02-26T12:20:27.255 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.268+0000 7f066f7fe640 1 -- 172.21.15.113:0/2220967033 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597582285 0 0) 0x7f067015e0a0 con 0x7f06700c35a0 2024-02-26T12:20:27.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.269+0000 7f0675312640 1 --2- 172.21.15.113:0/2220967033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06700cf8c0 0x7f0670168bb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f066802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b498aebad58ef97e server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.269+0000 7f066f7fe640 1 -- 172.21.15.113:0/2220967033 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668039070 con 0x7f06700cf8c0 2024-02-26T12:20:27.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.269+0000 7f066f7fe640 1 -- 172.21.15.113:0/2220967033 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066802cbd0 con 0x7f06700cf8c0 2024-02-26T12:20:27.256 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.269+0000 7f066f7fe640 1 -- 172.21.15.113:0/2220967033 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668034440 con 0x7f06700cf8c0 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 -- 172.21.15.113:0/2220967033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06700cf8c0 msgr2=0x7f0670168bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 --2- 172.21.15.113:0/2220967033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06700cf8c0 0x7f0670168bb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f066802be20 comp rx=0 tx=0).stop 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 -- 172.21.15.113:0/2220967033 shutdown_connections 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 --2- 172.21.15.113:0/2220967033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06700cf8c0 0x7f0670168bb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 -- 172.21.15.113:0/2220967033 >> 172.21.15.113:0/2220967033 conn(0x7f06700cc990 msgr2=0x7f06700ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.259 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 -- 172.21.15.113:0/2220967033 shutdown_connections 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.270+0000 7f0676d75640 1 -- 172.21.15.113:0/2220967033 wait complete. 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.271+0000 7f0676d75640 1 Processor -- start 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.271+0000 7f0676d75640 1 -- start start 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f06700c35a0 0x7f06700c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06700cf8c0 0x7f067015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 0x7f06700c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700cc2e0 con 0x7f067015dcc0 2024-02-26T12:20:27.260 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06700cc160 con 0x7f06700cf8c0 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0676d75640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06701690f0 con 0x7f06700c35a0 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 0x7f06700c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 0x7f06700c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44176/0 (socket says 172.21.15.113:44176) 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 -- 172.21.15.113:0/487993541 learned_addr learned my addr 172.21.15.113:0/487993541 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0674b11640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f06700c35a0 0x7f06700c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f066ffff640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06700cf8c0 0x7f067015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 -- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f06700c35a0 msgr2=0x7f06700c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.261 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f06700c35a0 0x7f06700c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 -- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06700cf8c0 msgr2=0x7f067015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06700cf8c0 0x7f067015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06700c7ca0 con 0x7f067015dcc0 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0674b11640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f06700c35a0 0x7f06700c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f066ffff640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06700cf8c0 0x7f067015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.272+0000 7f0675312640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 0x7f06700c6fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f0668004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.262 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668044020 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066803f470 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06700c7f80 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668039040 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06700c8540 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.273+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0670074a50 con 0x7f067015dcc0 2024-02-26T12:20:27.263 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.274+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0668047020 con 0x7f067015dcc0 2024-02-26T12:20:27.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.274+0000 7f066d7fa640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f065c06b4d0 0x7f065c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.264 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.274+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06680acdc0 con 0x7f067015dcc0 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.274+0000 7f0674b11640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f065c06b4d0 0x7f065c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f066d7fa640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f065c073670 0x7f065c075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0668042e50 con 0x7f065c073670 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06680af4c0 con 0x7f067015dcc0 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f066ffff640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f065c073670 0x7f065c075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f0674b11640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f065c06b4d0 0x7f065c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f066000a830 tx=0x7f0660008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.265 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.275+0000 7f066ffff640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f065c073670 0x7f065c075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.266 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.276+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== osd.7 v2:172.21.15.152:6808/276006357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0668042e50 con 0x7f065c073670 2024-02-26T12:20:27.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.289+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 --> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0670067070 con 0x7f065c073670 2024-02-26T12:20:27.274 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.289+0000 7f066d7fa640 1 -- 172.21.15.113:0/487993541 <== osd.7 v2:172.21.15.152:6808/276006357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0670067070 con 0x7f065c073670 2024-02-26T12:20:27.275 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2024-02-26T12:20:27.275 INFO:teuthology.orchestra.run.smithi113.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-26T12:20:27.275 INFO:teuthology.orchestra.run.smithi113.stdout:} 2024-02-26T12:20:27.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f065c073670 msgr2=0x7f065c075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.276 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.152:6808/276006357,v1:172.21.15.152:6809/276006357] conn(0x7f065c073670 0x7f065c075a90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f065c06b4d0 msgr2=0x7f065c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f065c06b4d0 0x7f065c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f066000a830 tx=0x7f0660008040 comp rx=0 tx=0).stop 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 msgr2=0x7f06700c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 --2- 172.21.15.113:0/487993541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f067015dcc0 0x7f06700c6fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0668009d90 tx=0x7f0668004a40 comp rx=0 tx=0).stop 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0675312640 1 -- 172.21.15.113:0/487993541 reap_dead start 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 shutdown_connections 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 >> 172.21.15.113:0/487993541 conn(0x7f06700cc990 msgr2=0x7f06700722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.277 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 shutdown_connections 2024-02-26T12:20:27.278 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.290+0000 7f0676d75640 1 -- 172.21.15.113:0/487993541 wait complete. 2024-02-26T12:20:27.286 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-26T12:20:27.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.403+0000 7fa9a2e08640 1 Processor -- start 2024-02-26T12:20:27.388 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.403+0000 7fa9a2e08640 1 -- start start 2024-02-26T12:20:27.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a2e08640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa99c0d2780 0x7fa99c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a2e08640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa99c0b7270 0x7fa99c0b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.390 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a2e08640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0b6db0 con 0x7fa99c0d04e0 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a2e08640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0d2bf0 con 0x7fa99c0b7270 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a2e08640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0d0e00 con 0x7fa99c0d2780 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a0ba4640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fa99c0d04e0 0x7fa99c0cedd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45064/0 (socket says 172.21.15.113:45064) 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a13a5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa99c0b7270 0x7fa99c0b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a0ba4640 1 -- 172.21.15.113:0/2912090970 learned_addr learned my addr 172.21.15.113:0/2912090970 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa99bfff640 1 --2- 172.21.15.113:0/2912090970 >> v2:172.21.15.152:3300/0 conn(0x7fa99c0d2780 0x7fa99c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa99b7fe640 1 -- 172.21.15.113:0/2912090970 <== mon.0 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381585397 0 0) 0x7fa990001110 con 0x7fa99c0d04e0 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa99b7fe640 1 -- 172.21.15.113:0/2912090970 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c003520 con 0x7fa99c0d04e0 2024-02-26T12:20:27.391 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a13a5640 1 -- 172.21.15.113:0/2912090970 >> v2:172.21.15.152:3300/0 conn(0x7fa99c0d2780 msgr2=0x7fa99c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a13a5640 1 --2- 172.21.15.113:0/2912090970 >> v2:172.21.15.152:3300/0 conn(0x7fa99c0d2780 0x7fa99c0d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a13a5640 1 -- 172.21.15.113:0/2912090970 >> v1:172.21.15.113:6789/0 conn(0x7fa99c0d04e0 legacy=0x7fa99c0cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.404+0000 7fa9a13a5640 1 -- 172.21.15.113:0/2912090970 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0d2e10 con 0x7fa99c0b7270 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.405+0000 7fa9a13a5640 1 --2- 172.21.15.113:0/2912090970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0b7270 0x7fa99c0b76a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0b6ba0 tx=0x7fa99402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f72f0ac2b5bfa server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.405+0000 7fa99b7fe640 1 -- 172.21.15.113:0/2912090970 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994039070 con 0x7fa99c0b7270 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.405+0000 7fa99b7fe640 1 -- 172.21.15.113:0/2912090970 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99402cbf0 con 0x7fa99c0b7270 2024-02-26T12:20:27.392 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.405+0000 7fa99b7fe640 1 -- 172.21.15.113:0/2912090970 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994034440 con 0x7fa99c0b7270 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2912090970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0b7270 msgr2=0x7fa99c0b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2912090970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0b7270 0x7fa99c0b76a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0b6ba0 tx=0x7fa99402be40 comp rx=0 tx=0).stop 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2912090970 shutdown_connections 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2912090970 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0b7270 0x7fa99c0b76a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2912090970 >> v2:172.21.15.152:3300/0 conn(0x7fa99c0d2780 0x7fa99c0d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2912090970 >> 172.21.15.113:0/2912090970 conn(0x7fa99c0728b0 msgr2=0x7fa99c0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2912090970 shutdown_connections 2024-02-26T12:20:27.396 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.406+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2912090970 wait complete. 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.407+0000 7fa9a2e08640 1 Processor -- start 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.407+0000 7fa9a2e08640 1 -- start start 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99c0b7270 0x7fa99c14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa99c0d2780 0x7fa99c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0d36b0 con 0x7fa99c0d04e0 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0d33d0 con 0x7fa99c0b7270 2024-02-26T12:20:27.397 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15e050 con 0x7fa99c0d2780 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44200/0 (socket says 172.21.15.113:44200) 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 -- 172.21.15.113:0/2393295164 learned_addr learned my addr 172.21.15.113:0/2393295164 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a13a5640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa99c0d2780 0x7fa99c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a0ba4640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99c0b7270 0x7fa99c14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 -- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa99c0d2780 msgr2=0x7fa99c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa99c0d2780 0x7fa99c0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.398 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 -- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99c0b7270 msgr2=0x7fa99c14cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99c0b7270 0x7fa99c14cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 -- 172.21.15.113:0/2393295164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0cbb60 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa99bfff640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa98800d800 tx=0x7fa98800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800b6c0 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988019070 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c157b70 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800ba80 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.408+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c158130 con 0x7fa99c0d04e0 2024-02-26T12:20:27.399 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.409+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c074a50 con 0x7fa99c0d04e0 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.410+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa98800bc20 con 0x7fa99c0d04e0 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.410+0000 7fa9997fa640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 0x7fa98006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.410+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa98808a620 con 0x7fa99c0d04e0 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.410+0000 7fa9a0ba4640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 0x7fa98006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.411+0000 7fa9a0ba4640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 0x7fa98006d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa990005880 tx=0x7fa990009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.400 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.414+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa988059530 con 0x7fa99c0d04e0 2024-02-26T12:20:27.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.585+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa99c0d4250 con 0x7fa98006b4d0 2024-02-26T12:20:27.571 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.586+0000 7fa9997fa640 1 -- 172.21.15.113:0/2393295164 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa99c0d4250 con 0x7fa98006b4d0 2024-02-26T12:20:27.571 INFO:teuthology.orchestra.run.smithi113.stderr:instructed osd(s) 7 to deep-scrub 2024-02-26T12:20:27.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 msgr2=0x7fa98006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.573 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 0x7fa98006d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa990005880 tx=0x7fa990009040 comp rx=0 tx=0).stop 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 msgr2=0x7fa99c0c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa98800d800 tx=0x7fa98800dcc0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 shutdown_connections 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fa98006b4d0 0x7fa98006d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa99c0d2780 0x7fa99c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa99c0d04e0 0x7fa99c0c87d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 --2- 172.21.15.113:0/2393295164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa99c0b7270 0x7fa99c14cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 >> 172.21.15.113:0/2393295164 conn(0x7fa99c0728b0 msgr2=0x7fa99c15f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 shutdown_connections 2024-02-26T12:20:27.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.588+0000 7fa9a2e08640 1 -- 172.21.15.113:0/2393295164 wait complete. 2024-02-26T12:20:27.584 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:27.684 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.699+0000 7f54cf436640 1 Processor -- start 2024-02-26T12:20:27.685 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.699+0000 7f54cf436640 1 -- start start 2024-02-26T12:20:27.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cf436640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c806ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cf436640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54c8070160 0x7f54c806b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cf436640 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c806b7a0 con 0x7f54c806dad0 2024-02-26T12:20:27.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cf436640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c806ba80 con 0x7f54c8070160 2024-02-26T12:20:27.686 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cf436640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c806bd60 con 0x7f54c806fd80 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cc9d1640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f54c8070160 0x7f54c806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cd9d3640 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f54c806dad0 0x7f54c806df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:45070/0 (socket says 172.21.15.113:45070) 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cd9d3640 1 -- 172.21.15.113:0/3326271877 learned_addr learned my addr 172.21.15.113:0/3326271877 (peer_addr_for_me v1:172.21.15.113:0/0) 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cc9d1640 1 -- 172.21.15.113:0/3326271877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 msgr2=0x7f54c806ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/3326271877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c806ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.700+0000 7f54cc9d1640 1 -- 172.21.15.113:0/3326271877 >> v1:172.21.15.113:6789/0 conn(0x7f54c806dad0 legacy=0x7f54c806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.701+0000 7f54cc9d1640 1 -- 172.21.15.113:0/3326271877 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c806c040 con 0x7f54c8070160 2024-02-26T12:20:27.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.701+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/3326271877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c8070160 0x7f54c806b090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097a0 tx=0x7f54b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f79281018887565 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.701+0000 7f54bffff640 1 -- 172.21.15.113:0/3326271877 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80315a0 con 0x7f54c8070160 2024-02-26T12:20:27.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.701+0000 7f54bffff640 1 -- 172.21.15.113:0/3326271877 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8037070 con 0x7f54c8070160 2024-02-26T12:20:27.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.701+0000 7f54bffff640 1 -- 172.21.15.113:0/3326271877 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8031960 con 0x7f54c8070160 2024-02-26T12:20:27.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 -- 172.21.15.113:0/3326271877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c8070160 msgr2=0x7f54c806b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 --2- 172.21.15.113:0/3326271877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c8070160 0x7f54c806b090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f54b80097a0 tx=0x7f54b802b840 comp rx=0 tx=0).stop 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 -- 172.21.15.113:0/3326271877 shutdown_connections 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 --2- 172.21.15.113:0/3326271877 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c8070160 0x7f54c806b090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 --2- 172.21.15.113:0/3326271877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c806ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 -- 172.21.15.113:0/3326271877 >> 172.21.15.113:0/3326271877 conn(0x7f54c80cc970 msgr2=0x7f54c80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 -- 172.21.15.113:0/3326271877 shutdown_connections 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.702+0000 7f54cf436640 1 -- 172.21.15.113:0/3326271877 wait complete. 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.703+0000 7f54cf436640 1 Processor -- start 2024-02-26T12:20:27.692 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.703+0000 7f54cf436640 1 -- start start 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c80c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 0x7f54c80c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815b660 con 0x7f54c806dad0 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815b4e0 con 0x7f54c8070160 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cf436640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815b7e0 con 0x7f54c806fd80 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.693 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:44216/0 (socket says 172.21.15.113:44216) 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 -- 172.21.15.113:0/2757412731 learned_addr learned my addr 172.21.15.113:0/2757412731 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c80c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd9d3640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 0x7f54c80c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 -- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 msgr2=0x7f54c80c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c80c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 -- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 msgr2=0x7f54c80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 0x7f54c80c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 -- 172.21.15.113:0/2757412731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80a0cb0 con 0x7f54c806dad0 2024-02-26T12:20:27.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c80c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd9d3640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 0x7f54c80c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.704+0000 7f54cd1d2640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ba50 tx=0x7f54c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.705+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4019070 con 0x7f54c806dad0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.705+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400cc00 con 0x7f54c806dad0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.705+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c809f6d0 con 0x7f54c806dad0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.705+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4014440 con 0x7f54c806dad0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.705+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c809ff70 con 0x7f54c806dad0 2024-02-26T12:20:27.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.706+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c809fac0 con 0x7f54c806dad0 2024-02-26T12:20:27.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.706+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54c401c070 con 0x7f54c806dad0 2024-02-26T12:20:27.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.706+0000 7f54bdffb640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:27.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.707+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:27.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.707+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54c4089fe0 con 0x7f54c806dad0 2024-02-26T12:20:27.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.707+0000 7f54cc9d1640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 0x7f54ac06d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54b8036000 tx=0x7f54b803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:27.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.711+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54c4058e60 con 0x7f54c806dad0 2024-02-26T12:20:27.865 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.880+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54c8074a50 con 0x7f54ac06b4d0 2024-02-26T12:20:27.870 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.886+0000 7f54bdffb640 1 -- 172.21.15.113:0/2757412731 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250140 (secure 0 0 0) 0x7f54c8074a50 con 0x7f54ac06b4d0 2024-02-26T12:20:27.873 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:27.875 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 msgr2=0x7f54ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.876 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 0x7f54ac06d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54b8036000 tx=0x7f54b803d040 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 msgr2=0x7f54c80a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f54c400ba50 tx=0x7f54c400bf10 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 shutdown_connections 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f54ac06b4d0 0x7f54ac06d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c8070160 0x7f54c80c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f54c806fd80 0x7f54c80c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 --2- 172.21.15.113:0/2757412731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54c806dad0 0x7f54c80a0770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:27.877 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 >> 172.21.15.113:0/2757412731 conn(0x7f54c80cc970 msgr2=0x7f54c80cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:27.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 shutdown_connections 2024-02-26T12:20:27.878 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:27.889+0000 7f54cf436640 1 -- 172.21.15.113:0/2757412731 wait complete. 2024-02-26T12:20:27.884 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-02-26T12:20:27.169702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220096,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754624,"statfs":{"total":773094113280,"available":772868734976,"internally_reserved":0,"allocated":4046848,"data_stored":2269630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002530"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352976+0000","last_change":"2024-02-26T12:20:06.844968+0000","last_active":"2024-02-26T12:20:08.352976+0000","last_peered":"2024-02-26T12:20:08.352976+0000","last_clean":"2024-02-26T12:20:08.352976+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:08.352976+0000","last_undegraded":"2024-02-26T12:20:08.352976+0000","last_fullsized":"2024-02-26T12:20:08.352976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:51:50.636359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353327+0000","last_change":"2024-02-26T12:20:06.849184+0000","last_active":"2024-02-26T12:20:08.353327+0000","last_peered":"2024-02-26T12:20:08.353327+0000","last_clean":"2024-02-26T12:20:08.353327+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:08.353327+0000","last_undegraded":"2024-02-26T12:20:08.353327+0000","last_fullsized":"2024-02-26T12:20:08.353327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841079+0000","last_change":"2024-02-26T12:20:06.834964+0000","last_active":"2024-02-26T12:20:07.841079+0000","last_peered":"2024-02-26T12:20:07.841079+0000","last_clean":"2024-02-26T12:20:07.841079+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:07.841079+0000","last_undegraded":"2024-02-26T12:20:07.841079+0000","last_fullsized":"2024-02-26T12:20:07.841079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352403+0000","last_change":"2024-02-26T12:20:06.852832+0000","last_active":"2024-02-26T12:20:08.352403+0000","last_peered":"2024-02-26T12:20:08.352403+0000","last_clean":"2024-02-26T12:20:08.352403+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:08.352403+0000","last_undegraded":"2024-02-26T12:20:08.352403+0000","last_fullsized":"2024-02-26T12:20:08.352403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352102+0000","last_change":"2024-02-26T12:20:06.852324+0000","last_active":"2024-02-26T12:20:08.352102+0000","last_peered":"2024-02-26T12:20:08.352102+0000","last_clean":"2024-02-26T12:20:08.352102+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:08.352102+0000","last_undegraded":"2024-02-26T12:20:08.352102+0000","last_fullsized":"2024-02-26T12:20:08.352102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353001+0000","last_change":"2024-02-26T12:20:06.849421+0000","last_active":"2024-02-26T12:20:08.353001+0000","last_peered":"2024-02-26T12:20:08.353001+0000","last_clean":"2024-02-26T12:20:08.353001+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:08.353001+0000","last_undegraded":"2024-02-26T12:20:08.353001+0000","last_fullsized":"2024-02-26T12:20:08.353001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353217+0000","last_change":"2024-02-26T12:20:06.843366+0000","last_active":"2024-02-26T12:20:08.353217+0000","last_peered":"2024-02-26T12:20:08.353217+0000","last_clean":"2024-02-26T12:20:08.353217+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:08.353217+0000","last_undegraded":"2024-02-26T12:20:08.353217+0000","last_fullsized":"2024-02-26T12:20:08.353217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:25.589137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352342+0000","last_change":"2024-02-26T12:20:06.839766+0000","last_active":"2024-02-26T12:20:08.352342+0000","last_peered":"2024-02-26T12:20:08.352342+0000","last_clean":"2024-02-26T12:20:08.352342+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:08.352342+0000","last_undegraded":"2024-02-26T12:20:08.352342+0000","last_fullsized":"2024-02-26T12:20:08.352342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841973+0000","last_change":"2024-02-26T12:20:06.848927+0000","last_active":"2024-02-26T12:20:07.841973+0000","last_peered":"2024-02-26T12:20:07.841973+0000","last_clean":"2024-02-26T12:20:07.841973+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:07.841973+0000","last_undegraded":"2024-02-26T12:20:07.841973+0000","last_fullsized":"2024-02-26T12:20:07.841973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:17:53.042885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352316+0000","last_change":"2024-02-26T12:20:06.850295+0000","last_active":"2024-02-26T12:20:08.352316+0000","last_peered":"2024-02-26T12:20:08.352316+0000","last_clean":"2024-02-26T12:20:08.352316+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:08.352316+0000","last_undegraded":"2024-02-26T12:20:08.352316+0000","last_fullsized":"2024-02-26T12:20:08.352316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353066+0000","last_change":"2024-02-26T12:20:06.846792+0000","last_active":"2024-02-26T12:20:08.353066+0000","last_peered":"2024-02-26T12:20:08.353066+0000","last_clean":"2024-02-26T12:20:08.353066+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:08.353066+0000","last_undegraded":"2024-02-26T12:20:08.353066+0000","last_fullsized":"2024-02-26T12:20:08.353066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840815+0000","last_change":"2024-02-26T12:20:06.850771+0000","last_active":"2024-02-26T12:20:07.840815+0000","last_peered":"2024-02-26T12:20:07.840815+0000","last_clean":"2024-02-26T12:20:07.840815+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:07.840815+0000","last_undegraded":"2024-02-26T12:20:07.840815+0000","last_fullsized":"2024-02-26T12:20:07.840815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352255+0000","last_change":"2024-02-26T12:20:06.845105+0000","last_active":"2024-02-26T12:20:08.352255+0000","last_peered":"2024-02-26T12:20:08.352255+0000","last_clean":"2024-02-26T12:20:08.352255+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:08.352255+0000","last_undegraded":"2024-02-26T12:20:08.352255+0000","last_fullsized":"2024-02-26T12:20:08.352255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353134+0000","last_change":"2024-02-26T12:20:06.849132+0000","last_active":"2024-02-26T12:20:08.353134+0000","last_peered":"2024-02-26T12:20:08.353134+0000","last_clean":"2024-02-26T12:20:08.353134+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:08.353134+0000","last_undegraded":"2024-02-26T12:20:08.353134+0000","last_fullsized":"2024-02-26T12:20:08.353134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840492+0000","last_change":"2024-02-26T12:20:06.843678+0000","last_active":"2024-02-26T12:20:07.840492+0000","last_peered":"2024-02-26T12:20:07.840492+0000","last_clean":"2024-02-26T12:20:07.840492+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:07.840492+0000","last_undegraded":"2024-02-26T12:20:07.840492+0000","last_fullsized":"2024-02-26T12:20:07.840492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:01.776176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352649+0000","last_change":"2024-02-26T12:20:06.850419+0000","last_active":"2024-02-26T12:20:08.352649+0000","last_peered":"2024-02-26T12:20:08.352649+0000","last_clean":"2024-02-26T12:20:08.352649+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:08.352649+0000","last_undegraded":"2024-02-26T12:20:08.352649+0000","last_fullsized":"2024-02-26T12:20:08.352649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353213+0000","last_change":"2024-02-26T12:20:06.846044+0000","last_active":"2024-02-26T12:20:08.353213+0000","last_peered":"2024-02-26T12:20:08.353213+0000","last_clean":"2024-02-26T12:20:08.353213+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:08.353213+0000","last_undegraded":"2024-02-26T12:20:08.353213+0000","last_fullsized":"2024-02-26T12:20:08.353213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353402+0000","last_change":"2024-02-26T12:20:06.849063+0000","last_active":"2024-02-26T12:20:08.353402+0000","last_peered":"2024-02-26T12:20:08.353402+0000","last_clean":"2024-02-26T12:20:08.353402+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:08.353402+0000","last_undegraded":"2024-02-26T12:20:08.353402+0000","last_fullsized":"2024-02-26T12:20:08.353402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353296+0000","last_change":"2024-02-26T12:20:06.854247+0000","last_active":"2024-02-26T12:20:08.353296+0000","last_peered":"2024-02-26T12:20:08.353296+0000","last_clean":"2024-02-26T12:20:08.353296+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:08.353296+0000","last_undegraded":"2024-02-26T12:20:08.353296+0000","last_fullsized":"2024-02-26T12:20:08.353296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352430+0000","last_change":"2024-02-26T12:20:06.847720+0000","last_active":"2024-02-26T12:20:08.352430+0000","last_peered":"2024-02-26T12:20:08.352430+0000","last_clean":"2024-02-26T12:20:08.352430+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:08.352430+0000","last_undegraded":"2024-02-26T12:20:08.352430+0000","last_fullsized":"2024-02-26T12:20:08.352430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841645+0000","last_change":"2024-02-26T12:20:06.835429+0000","last_active":"2024-02-26T12:20:07.841645+0000","last_peered":"2024-02-26T12:20:07.841645+0000","last_clean":"2024-02-26T12:20:07.841645+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:07.841645+0000","last_undegraded":"2024-02-26T12:20:07.841645+0000","last_fullsized":"2024-02-26T12:20:07.841645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:37.928321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841332+0000","last_change":"2024-02-26T12:20:06.849789+0000","last_active":"2024-02-26T12:20:07.841332+0000","last_peered":"2024-02-26T12:20:07.841332+0000","last_clean":"2024-02-26T12:20:07.841332+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:07.841332+0000","last_undegraded":"2024-02-26T12:20:07.841332+0000","last_fullsized":"2024-02-26T12:20:07.841332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:24.470080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840320+0000","last_change":"2024-02-26T12:20:06.840392+0000","last_active":"2024-02-26T12:20:07.840320+0000","last_peered":"2024-02-26T12:20:07.840320+0000","last_clean":"2024-02-26T12:20:07.840320+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:07.840320+0000","last_undegraded":"2024-02-26T12:20:07.840320+0000","last_fullsized":"2024-02-26T12:20:07.840320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840620+0000","last_change":"2024-02-26T12:20:06.838075+0000","last_active":"2024-02-26T12:20:07.840620+0000","last_peered":"2024-02-26T12:20:07.840620+0000","last_clean":"2024-02-26T12:20:07.840620+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:07.840620+0000","last_undegraded":"2024-02-26T12:20:07.840620+0000","last_fullsized":"2024-02-26T12:20:07.840620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352851+0000","last_change":"2024-02-26T12:20:06.844929+0000","last_active":"2024-02-26T12:20:08.352851+0000","last_peered":"2024-02-26T12:20:08.352851+0000","last_clean":"2024-02-26T12:20:08.352851+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:08.352851+0000","last_undegraded":"2024-02-26T12:20:08.352851+0000","last_fullsized":"2024-02-26T12:20:08.352851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353474+0000","last_change":"2024-02-26T12:20:06.848784+0000","last_active":"2024-02-26T12:20:08.353474+0000","last_peered":"2024-02-26T12:20:08.353474+0000","last_clean":"2024-02-26T12:20:08.353474+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:08.353474+0000","last_undegraded":"2024-02-26T12:20:08.353474+0000","last_fullsized":"2024-02-26T12:20:08.353474+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352870+0000","last_change":"2024-02-26T12:20:06.852296+0000","last_active":"2024-02-26T12:20:08.352870+0000","last_peered":"2024-02-26T12:20:08.352870+0000","last_clean":"2024-02-26T12:20:08.352870+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:08.352870+0000","last_undegraded":"2024-02-26T12:20:08.352870+0000","last_fullsized":"2024-02-26T12:20:08.352870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840972+0000","last_change":"2024-02-26T12:20:06.834398+0000","last_active":"2024-02-26T12:20:07.840972+0000","last_peered":"2024-02-26T12:20:07.840972+0000","last_clean":"2024-02-26T12:20:07.840972+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:07.840972+0000","last_undegraded":"2024-02-26T12:20:07.840972+0000","last_fullsized":"2024-02-26T12:20:07.840972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841814+0000","last_change":"2024-02-26T12:20:06.851836+0000","last_active":"2024-02-26T12:20:07.841814+0000","last_peered":"2024-02-26T12:20:07.841814+0000","last_clean":"2024-02-26T12:20:07.841814+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:07.841814+0000","last_undegraded":"2024-02-26T12:20:07.841814+0000","last_fullsized":"2024-02-26T12:20:07.841814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:36.352906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352646+0000","last_change":"2024-02-26T12:20:06.840747+0000","last_active":"2024-02-26T12:20:08.352646+0000","last_peered":"2024-02-26T12:20:08.352646+0000","last_clean":"2024-02-26T12:20:08.352646+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:08.352646+0000","last_undegraded":"2024-02-26T12:20:08.352646+0000","last_fullsized":"2024-02-26T12:20:08.352646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352534+0000","last_change":"2024-02-26T12:20:06.848793+0000","last_active":"2024-02-26T12:20:08.352534+0000","last_peered":"2024-02-26T12:20:08.352534+0000","last_clean":"2024-02-26T12:20:08.352534+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:08.352534+0000","last_undegraded":"2024-02-26T12:20:08.352534+0000","last_fullsized":"2024-02-26T12:20:08.352534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:46.070219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352385+0000","last_change":"2024-02-26T12:20:06.846528+0000","last_active":"2024-02-26T12:20:08.352385+0000","last_peered":"2024-02-26T12:20:08.352385+0000","last_clean":"2024-02-26T12:20:08.352385+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:08.352385+0000","last_undegraded":"2024-02-26T12:20:08.352385+0000","last_fullsized":"2024-02-26T12:20:08.352385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:21.427149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840513+0000","last_change":"2024-02-26T12:20:06.839103+0000","last_active":"2024-02-26T12:20:07.840513+0000","last_peered":"2024-02-26T12:20:07.840513+0000","last_clean":"2024-02-26T12:20:07.840513+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:07.840513+0000","last_undegraded":"2024-02-26T12:20:07.840513+0000","last_fullsized":"2024-02-26T12:20:07.840513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353090+0000","last_change":"2024-02-26T12:20:05.848588+0000","last_active":"2024-02-26T12:20:08.353090+0000","last_peered":"2024-02-26T12:20:08.353090+0000","last_clean":"2024-02-26T12:20:08.353090+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:08.353090+0000","last_undegraded":"2024-02-26T12:20:08.353090+0000","last_fullsized":"2024-02-26T12:20:08.353090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353108+0000","last_change":"2024-02-26T12:20:06.844293+0000","last_active":"2024-02-26T12:20:08.353108+0000","last_peered":"2024-02-26T12:20:08.353108+0000","last_clean":"2024-02-26T12:20:08.353108+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:08.353108+0000","last_undegraded":"2024-02-26T12:20:08.353108+0000","last_fullsized":"2024-02-26T12:20:08.353108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840430+0000","last_change":"2024-02-26T12:20:05.841870+0000","last_active":"2024-02-26T12:20:07.840430+0000","last_peered":"2024-02-26T12:20:07.840430+0000","last_clean":"2024-02-26T12:20:07.840430+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:07.840430+0000","last_undegraded":"2024-02-26T12:20:07.840430+0000","last_fullsized":"2024-02-26T12:20:07.840430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842032+0000","last_change":"2024-02-26T12:20:06.851045+0000","last_active":"2024-02-26T12:20:07.842032+0000","last_peered":"2024-02-26T12:20:07.842032+0000","last_clean":"2024-02-26T12:20:07.842032+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:07.842032+0000","last_undegraded":"2024-02-26T12:20:07.842032+0000","last_fullsized":"2024-02-26T12:20:07.842032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:29:06.890500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353394+0000","last_change":"2024-02-26T12:20:05.843475+0000","last_active":"2024-02-26T12:20:08.353394+0000","last_peered":"2024-02-26T12:20:08.353394+0000","last_clean":"2024-02-26T12:20:08.353394+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:08.353394+0000","last_undegraded":"2024-02-26T12:20:08.353394+0000","last_fullsized":"2024-02-26T12:20:08.353394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353026+0000","last_change":"2024-02-26T12:20:06.839258+0000","last_active":"2024-02-26T12:20:08.353026+0000","last_peered":"2024-02-26T12:20:08.353026+0000","last_clean":"2024-02-26T12:20:08.353026+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:08.353026+0000","last_undegraded":"2024-02-26T12:20:08.353026+0000","last_fullsized":"2024-02-26T12:20:08.353026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352521+0000","last_change":"2024-02-26T12:20:05.833483+0000","last_active":"2024-02-26T12:20:08.352521+0000","last_peered":"2024-02-26T12:20:08.352521+0000","last_clean":"2024-02-26T12:20:08.352521+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:08.352521+0000","last_undegraded":"2024-02-26T12:20:08.352521+0000","last_fullsized":"2024-02-26T12:20:08.352521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352818+0000","last_change":"2024-02-26T12:20:06.846106+0000","last_active":"2024-02-26T12:20:08.352818+0000","last_peered":"2024-02-26T12:20:08.352818+0000","last_clean":"2024-02-26T12:20:08.352818+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:08.352818+0000","last_undegraded":"2024-02-26T12:20:08.352818+0000","last_fullsized":"2024-02-26T12:20:08.352818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:02.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841764+0000","last_change":"2024-02-26T12:20:05.847361+0000","last_active":"2024-02-26T12:20:07.841764+0000","last_peered":"2024-02-26T12:20:07.841764+0000","last_clean":"2024-02-26T12:20:07.841764+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:07.841764+0000","last_undegraded":"2024-02-26T12:20:07.841764+0000","last_fullsized":"2024-02-26T12:20:07.841764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840887+0000","last_change":"2024-02-26T12:20:06.835746+0000","last_active":"2024-02-26T12:20:07.840887+0000","last_peered":"2024-02-26T12:20:07.840887+0000","last_clean":"2024-02-26T12:20:07.840887+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:07.840887+0000","last_undegraded":"2024-02-26T12:20:07.840887+0000","last_fullsized":"2024-02-26T12:20:07.840887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:50:52.180019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841583+0000","last_change":"2024-02-26T12:20:05.845146+0000","last_active":"2024-02-26T12:20:07.841583+0000","last_peered":"2024-02-26T12:20:07.841583+0000","last_clean":"2024-02-26T12:20:07.841583+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:07.841583+0000","last_undegraded":"2024-02-26T12:20:07.841583+0000","last_fullsized":"2024-02-26T12:20:07.841583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:26:53.681917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840817+0000","last_change":"2024-02-26T12:20:06.840340+0000","last_active":"2024-02-26T12:20:07.840817+0000","last_peered":"2024-02-26T12:20:07.840817+0000","last_clean":"2024-02-26T12:20:07.840817+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:07.840817+0000","last_undegraded":"2024-02-26T12:20:07.840817+0000","last_fullsized":"2024-02-26T12:20:07.840817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:14:55.795288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353103+0000","last_change":"2024-02-26T12:20:05.838969+0000","last_active":"2024-02-26T12:20:08.353103+0000","last_peered":"2024-02-26T12:20:08.353103+0000","last_clean":"2024-02-26T12:20:08.353103+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:08.353103+0000","last_undegraded":"2024-02-26T12:20:08.353103+0000","last_fullsized":"2024-02-26T12:20:08.353103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352310+0000","last_change":"2024-02-26T12:20:06.838655+0000","last_active":"2024-02-26T12:20:08.352310+0000","last_peered":"2024-02-26T12:20:08.352310+0000","last_clean":"2024-02-26T12:20:08.352310+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:08.352310+0000","last_undegraded":"2024-02-26T12:20:08.352310+0000","last_fullsized":"2024-02-26T12:20:08.352310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840460+0000","last_change":"2024-02-26T12:20:05.843525+0000","last_active":"2024-02-26T12:20:07.840460+0000","last_peered":"2024-02-26T12:20:07.840460+0000","last_clean":"2024-02-26T12:20:07.840460+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:07.840460+0000","last_undegraded":"2024-02-26T12:20:07.840460+0000","last_fullsized":"2024-02-26T12:20:07.840460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:10:44.663591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840823+0000","last_change":"2024-02-26T12:20:06.851695+0000","last_active":"2024-02-26T12:20:07.840823+0000","last_peered":"2024-02-26T12:20:07.840823+0000","last_clean":"2024-02-26T12:20:07.840823+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:07.840823+0000","last_undegraded":"2024-02-26T12:20:07.840823+0000","last_fullsized":"2024-02-26T12:20:07.840823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:17:40.405674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353649+0000","last_change":"2024-02-26T12:20:05.843349+0000","last_active":"2024-02-26T12:20:08.353649+0000","last_peered":"2024-02-26T12:20:08.353649+0000","last_clean":"2024-02-26T12:20:08.353649+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:08.353649+0000","last_undegraded":"2024-02-26T12:20:08.353649+0000","last_fullsized":"2024-02-26T12:20:08.353649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353597+0000","last_change":"2024-02-26T12:20:06.852393+0000","last_active":"2024-02-26T12:20:08.353597+0000","last_peered":"2024-02-26T12:20:08.353597+0000","last_clean":"2024-02-26T12:20:08.353597+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:08.353597+0000","last_undegraded":"2024-02-26T12:20:08.353597+0000","last_fullsized":"2024-02-26T12:20:08.353597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840525+0000","last_change":"2024-02-26T12:20:05.845096+0000","last_active":"2024-02-26T12:20:07.840525+0000","last_peered":"2024-02-26T12:20:07.840525+0000","last_clean":"2024-02-26T12:20:07.840525+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:07.840525+0000","last_undegraded":"2024-02-26T12:20:07.840525+0000","last_fullsized":"2024-02-26T12:20:07.840525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352815+0000","last_change":"2024-02-26T12:20:06.849481+0000","last_active":"2024-02-26T12:20:08.352815+0000","last_peered":"2024-02-26T12:20:08.352815+0000","last_clean":"2024-02-26T12:20:08.352815+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:08.352815+0000","last_undegraded":"2024-02-26T12:20:08.352815+0000","last_fullsized":"2024-02-26T12:20:08.352815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841138+0000","last_change":"2024-02-26T12:20:05.838838+0000","last_active":"2024-02-26T12:20:07.841138+0000","last_peered":"2024-02-26T12:20:07.841138+0000","last_clean":"2024-02-26T12:20:07.841138+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:07.841138+0000","last_undegraded":"2024-02-26T12:20:07.841138+0000","last_fullsized":"2024-02-26T12:20:07.841138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:23.466215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841041+0000","last_change":"2024-02-26T12:20:06.834421+0000","last_active":"2024-02-26T12:20:07.841041+0000","last_peered":"2024-02-26T12:20:07.841041+0000","last_clean":"2024-02-26T12:20:07.841041+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:07.841041+0000","last_undegraded":"2024-02-26T12:20:07.841041+0000","last_fullsized":"2024-02-26T12:20:07.841041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'10","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:20.915328+0000","last_change":"2024-02-26T12:20:05.845249+0000","last_active":"2024-02-26T12:20:20.915328+0000","last_peered":"2024-02-26T12:20:20.915328+0000","last_clean":"2024-02-26T12:20:20.915328+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:20.915328+0000","last_undegraded":"2024-02-26T12:20:20.915328+0000","last_fullsized":"2024-02-26T12:20:20.915328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353113+0000","last_change":"2024-02-26T12:20:06.841973+0000","last_active":"2024-02-26T12:20:08.353113+0000","last_peered":"2024-02-26T12:20:08.353113+0000","last_clean":"2024-02-26T12:20:08.353113+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:08.353113+0000","last_undegraded":"2024-02-26T12:20:08.353113+0000","last_fullsized":"2024-02-26T12:20:08.353113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841896+0000","last_change":"2024-02-26T12:20:05.845777+0000","last_active":"2024-02-26T12:20:07.841896+0000","last_peered":"2024-02-26T12:20:07.841896+0000","last_clean":"2024-02-26T12:20:07.841896+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:07.841896+0000","last_undegraded":"2024-02-26T12:20:07.841896+0000","last_fullsized":"2024-02-26T12:20:07.841896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:45:39.058030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353636+0000","last_change":"2024-02-26T12:20:06.849714+0000","last_active":"2024-02-26T12:20:08.353636+0000","last_peered":"2024-02-26T12:20:08.353636+0000","last_clean":"2024-02-26T12:20:08.353636+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:08.353636+0000","last_undegraded":"2024-02-26T12:20:08.353636+0000","last_fullsized":"2024-02-26T12:20:08.353636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352870+0000","last_change":"2024-02-26T12:20:05.846330+0000","last_active":"2024-02-26T12:20:08.352870+0000","last_peered":"2024-02-26T12:20:08.352870+0000","last_clean":"2024-02-26T12:20:08.352870+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:08.352870+0000","last_undegraded":"2024-02-26T12:20:08.352870+0000","last_fullsized":"2024-02-26T12:20:08.352870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352543+0000","last_change":"2024-02-26T12:20:06.846095+0000","last_active":"2024-02-26T12:20:08.352543+0000","last_peered":"2024-02-26T12:20:08.352543+0000","last_clean":"2024-02-26T12:20:08.352543+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:08.352543+0000","last_undegraded":"2024-02-26T12:20:08.352543+0000","last_fullsized":"2024-02-26T12:20:08.352543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:11:23.490284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353117+0000","last_change":"2024-02-26T12:20:05.843366+0000","last_active":"2024-02-26T12:20:08.353117+0000","last_peered":"2024-02-26T12:20:08.353117+0000","last_clean":"2024-02-26T12:20:08.353117+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:08.353117+0000","last_undegraded":"2024-02-26T12:20:08.353117+0000","last_fullsized":"2024-02-26T12:20:08.353117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352570+0000","last_change":"2024-02-26T12:20:06.844305+0000","last_active":"2024-02-26T12:20:08.352570+0000","last_peered":"2024-02-26T12:20:08.352570+0000","last_clean":"2024-02-26T12:20:08.352570+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:08.352570+0000","last_undegraded":"2024-02-26T12:20:08.352570+0000","last_fullsized":"2024-02-26T12:20:08.352570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:55:35.566266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352882+0000","last_change":"2024-02-26T12:20:05.842059+0000","last_active":"2024-02-26T12:20:08.352882+0000","last_peered":"2024-02-26T12:20:08.352882+0000","last_clean":"2024-02-26T12:20:08.352882+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:08.352882+0000","last_undegraded":"2024-02-26T12:20:08.352882+0000","last_fullsized":"2024-02-26T12:20:08.352882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841724+0000","last_change":"2024-02-26T12:20:06.836689+0000","last_active":"2024-02-26T12:20:07.841724+0000","last_peered":"2024-02-26T12:20:07.841724+0000","last_clean":"2024-02-26T12:20:07.841724+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:07.841724+0000","last_undegraded":"2024-02-26T12:20:07.841724+0000","last_fullsized":"2024-02-26T12:20:07.841724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:15.269931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353015+0000","last_change":"2024-02-26T12:20:05.845623+0000","last_active":"2024-02-26T12:20:08.353015+0000","last_peered":"2024-02-26T12:20:08.353015+0000","last_clean":"2024-02-26T12:20:08.353015+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:08.353015+0000","last_undegraded":"2024-02-26T12:20:08.353015+0000","last_fullsized":"2024-02-26T12:20:08.353015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841468+0000","last_change":"2024-02-26T12:20:06.847756+0000","last_active":"2024-02-26T12:20:07.841468+0000","last_peered":"2024-02-26T12:20:07.841468+0000","last_clean":"2024-02-26T12:20:07.841468+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:07.841468+0000","last_undegraded":"2024-02-26T12:20:07.841468+0000","last_fullsized":"2024-02-26T12:20:07.841468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:31.726163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841807+0000","last_change":"2024-02-26T12:20:05.846120+0000","last_active":"2024-02-26T12:20:07.841807+0000","last_peered":"2024-02-26T12:20:07.841807+0000","last_clean":"2024-02-26T12:20:07.841807+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:07.841807+0000","last_undegraded":"2024-02-26T12:20:07.841807+0000","last_fullsized":"2024-02-26T12:20:07.841807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352480+0000","last_change":"2024-02-26T12:20:06.851971+0000","last_active":"2024-02-26T12:20:08.352480+0000","last_peered":"2024-02-26T12:20:08.352480+0000","last_clean":"2024-02-26T12:20:08.352480+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:08.352480+0000","last_undegraded":"2024-02-26T12:20:08.352480+0000","last_fullsized":"2024-02-26T12:20:08.352480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841761+0000","last_change":"2024-02-26T12:20:05.837699+0000","last_active":"2024-02-26T12:20:07.841761+0000","last_peered":"2024-02-26T12:20:07.841761+0000","last_clean":"2024-02-26T12:20:07.841761+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:07.841761+0000","last_undegraded":"2024-02-26T12:20:07.841761+0000","last_fullsized":"2024-02-26T12:20:07.841761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:30:35.374700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352209+0000","last_change":"2024-02-26T12:20:06.841194+0000","last_active":"2024-02-26T12:20:08.352209+0000","last_peered":"2024-02-26T12:20:08.352209+0000","last_clean":"2024-02-26T12:20:08.352209+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:08.352209+0000","last_undegraded":"2024-02-26T12:20:08.352209+0000","last_fullsized":"2024-02-26T12:20:08.352209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.842034+0000","last_change":"2024-02-26T12:20:05.845167+0000","last_active":"2024-02-26T12:20:07.842034+0000","last_peered":"2024-02-26T12:20:07.842034+0000","last_clean":"2024-02-26T12:20:07.842034+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:07.842034+0000","last_undegraded":"2024-02-26T12:20:07.842034+0000","last_fullsized":"2024-02-26T12:20:07.842034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:35.563718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352089+0000","last_change":"2024-02-26T12:20:06.841086+0000","last_active":"2024-02-26T12:20:08.352089+0000","last_peered":"2024-02-26T12:20:08.352089+0000","last_clean":"2024-02-26T12:20:08.352089+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:08.352089+0000","last_undegraded":"2024-02-26T12:20:08.352089+0000","last_fullsized":"2024-02-26T12:20:08.352089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840397+0000","last_change":"2024-02-26T12:20:05.838831+0000","last_active":"2024-02-26T12:20:07.840397+0000","last_peered":"2024-02-26T12:20:07.840397+0000","last_clean":"2024-02-26T12:20:07.840397+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:07.840397+0000","last_undegraded":"2024-02-26T12:20:07.840397+0000","last_fullsized":"2024-02-26T12:20:07.840397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352397+0000","last_change":"2024-02-26T12:20:06.847035+0000","last_active":"2024-02-26T12:20:08.352397+0000","last_peered":"2024-02-26T12:20:08.352397+0000","last_clean":"2024-02-26T12:20:08.352397+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:08.352397+0000","last_undegraded":"2024-02-26T12:20:08.352397+0000","last_fullsized":"2024-02-26T12:20:08.352397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352952+0000","last_change":"2024-02-26T12:20:05.847639+0000","last_active":"2024-02-26T12:20:08.352952+0000","last_peered":"2024-02-26T12:20:08.352952+0000","last_clean":"2024-02-26T12:20:08.352952+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:08.352952+0000","last_undegraded":"2024-02-26T12:20:08.352952+0000","last_fullsized":"2024-02-26T12:20:08.352952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:00:01.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.351995+0000","last_change":"2024-02-26T12:20:06.836131+0000","last_active":"2024-02-26T12:20:08.351995+0000","last_peered":"2024-02-26T12:20:08.351995+0000","last_clean":"2024-02-26T12:20:08.351995+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:08.351995+0000","last_undegraded":"2024-02-26T12:20:08.351995+0000","last_fullsized":"2024-02-26T12:20:08.351995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841367+0000","last_change":"2024-02-26T12:20:05.842008+0000","last_active":"2024-02-26T12:20:07.841367+0000","last_peered":"2024-02-26T12:20:07.841367+0000","last_clean":"2024-02-26T12:20:07.841367+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:07.841367+0000","last_undegraded":"2024-02-26T12:20:07.841367+0000","last_fullsized":"2024-02-26T12:20:07.841367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:26:43.440326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352683+0000","last_change":"2024-02-26T12:20:06.843136+0000","last_active":"2024-02-26T12:20:08.352683+0000","last_peered":"2024-02-26T12:20:08.352683+0000","last_clean":"2024-02-26T12:20:08.352683+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:08.352683+0000","last_undegraded":"2024-02-26T12:20:08.352683+0000","last_fullsized":"2024-02-26T12:20:08.352683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:26.427181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840292+0000","last_change":"2024-02-26T12:20:05.838217+0000","last_active":"2024-02-26T12:20:07.840292+0000","last_peered":"2024-02-26T12:20:07.840292+0000","last_clean":"2024-02-26T12:20:07.840292+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:07.840292+0000","last_undegraded":"2024-02-26T12:20:07.840292+0000","last_fullsized":"2024-02-26T12:20:07.840292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:36.924456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352086+0000","last_change":"2024-02-26T12:20:06.843988+0000","last_active":"2024-02-26T12:20:08.352086+0000","last_peered":"2024-02-26T12:20:08.352086+0000","last_clean":"2024-02-26T12:20:08.352086+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:08.352086+0000","last_undegraded":"2024-02-26T12:20:08.352086+0000","last_fullsized":"2024-02-26T12:20:08.352086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:25.335971+0000","last_change":"2024-02-26T12:20:25.336033+0000","last_active":"2024-02-26T12:20:25.335971+0000","last_peered":"2024-02-26T12:20:25.335971+0000","last_clean":"2024-02-26T12:20:25.335971+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:25.335971+0000","last_undegraded":"2024-02-26T12:20:25.335971+0000","last_fullsized":"2024-02-26T12:20:25.335971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:25.335857+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:25.335857+0000","last_clean_scrub_stamp":"2024-02-26T12:20:25.335857+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:45.948326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841445+0000","last_change":"2024-02-26T12:20:06.846498+0000","last_active":"2024-02-26T12:20:07.841445+0000","last_peered":"2024-02-26T12:20:07.841445+0000","last_clean":"2024-02-26T12:20:07.841445+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:07.841445+0000","last_undegraded":"2024-02-26T12:20:07.841445+0000","last_fullsized":"2024-02-26T12:20:07.841445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:39:48.620802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:21.832468+0000","last_change":"2024-02-26T12:20:05.839490+0000","last_active":"2024-02-26T12:20:21.832468+0000","last_peered":"2024-02-26T12:20:21.832468+0000","last_clean":"2024-02-26T12:20:21.832468+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:21.832468+0000","last_undegraded":"2024-02-26T12:20:21.832468+0000","last_fullsized":"2024-02-26T12:20:21.832468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840353+0000","last_change":"2024-02-26T12:20:06.840249+0000","last_active":"2024-02-26T12:20:07.840353+0000","last_peered":"2024-02-26T12:20:07.840353+0000","last_clean":"2024-02-26T12:20:07.840353+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:07.840353+0000","last_undegraded":"2024-02-26T12:20:07.840353+0000","last_fullsized":"2024-02-26T12:20:07.840353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352564+0000","last_change":"2024-02-26T12:20:05.841531+0000","last_active":"2024-02-26T12:20:08.352564+0000","last_peered":"2024-02-26T12:20:08.352564+0000","last_clean":"2024-02-26T12:20:08.352564+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:08.352564+0000","last_undegraded":"2024-02-26T12:20:08.352564+0000","last_fullsized":"2024-02-26T12:20:08.352564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352648+0000","last_change":"2024-02-26T12:20:06.844149+0000","last_active":"2024-02-26T12:20:08.352648+0000","last_peered":"2024-02-26T12:20:08.352648+0000","last_clean":"2024-02-26T12:20:08.352648+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:08.352648+0000","last_undegraded":"2024-02-26T12:20:08.352648+0000","last_fullsized":"2024-02-26T12:20:08.352648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:12.884745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:25.410194+0000","last_change":"2024-02-26T12:20:25.410230+0000","last_active":"2024-02-26T12:20:25.410194+0000","last_peered":"2024-02-26T12:20:25.410194+0000","last_clean":"2024-02-26T12:20:25.410194+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:25.410194+0000","last_undegraded":"2024-02-26T12:20:25.410194+0000","last_fullsized":"2024-02-26T12:20:25.410194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:25.410080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:25.410080+0000","last_clean_scrub_stamp":"2024-02-26T12:20:25.410080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:18:12.638253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840395+0000","last_change":"2024-02-26T12:20:06.846886+0000","last_active":"2024-02-26T12:20:07.840395+0000","last_peered":"2024-02-26T12:20:07.840395+0000","last_clean":"2024-02-26T12:20:07.840395+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:07.840395+0000","last_undegraded":"2024-02-26T12:20:07.840395+0000","last_fullsized":"2024-02-26T12:20:07.840395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.353141+0000","last_change":"2024-02-26T12:20:05.840330+0000","last_active":"2024-02-26T12:20:08.353141+0000","last_peered":"2024-02-26T12:20:08.353141+0000","last_clean":"2024-02-26T12:20:08.353141+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:08.353141+0000","last_undegraded":"2024-02-26T12:20:08.353141+0000","last_fullsized":"2024-02-26T12:20:08.353141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352773+0000","last_change":"2024-02-26T12:20:06.849839+0000","last_active":"2024-02-26T12:20:08.352773+0000","last_peered":"2024-02-26T12:20:08.352773+0000","last_clean":"2024-02-26T12:20:08.352773+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:08.352773+0000","last_undegraded":"2024-02-26T12:20:08.352773+0000","last_fullsized":"2024-02-26T12:20:08.352773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.841436+0000","last_change":"2024-02-26T12:20:05.838566+0000","last_active":"2024-02-26T12:20:07.841436+0000","last_peered":"2024-02-26T12:20:07.841436+0000","last_clean":"2024-02-26T12:20:07.841436+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:07.841436+0000","last_undegraded":"2024-02-26T12:20:07.841436+0000","last_fullsized":"2024-02-26T12:20:07.841436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:57:36.704027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:07.840423+0000","last_change":"2024-02-26T12:20:06.849696+0000","last_active":"2024-02-26T12:20:07.840423+0000","last_peered":"2024-02-26T12:20:07.840423+0000","last_clean":"2024-02-26T12:20:07.840423+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:07.840423+0000","last_undegraded":"2024-02-26T12:20:07.840423+0000","last_fullsized":"2024-02-26T12:20:07.840423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:40:16.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352982+0000","last_change":"2024-02-26T12:20:05.841013+0000","last_active":"2024-02-26T12:20:08.352982+0000","last_peered":"2024-02-26T12:20:08.352982+0000","last_clean":"2024-02-26T12:20:08.352982+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:08.352982+0000","last_undegraded":"2024-02-26T12:20:08.352982+0000","last_fullsized":"2024-02-26T12:20:08.352982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352828+0000","last_change":"2024-02-26T12:20:06.839596+0000","last_active":"2024-02-26T12:20:08.352828+0000","last_peered":"2024-02-26T12:20:08.352828+0000","last_clean":"2024-02-26T12:20:08.352828+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:08.352828+0000","last_undegraded":"2024-02-26T12:20:08.352828+0000","last_fullsized":"2024-02-26T12:20:08.352828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:05.814713+0000","last_clean_scrub_stamp":"2024-02-26T12:20:05.814713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:57:36.878000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352875+0000","last_change":"2024-02-26T12:20:05.848542+0000","last_active":"2024-02-26T12:20:08.352875+0000","last_peered":"2024-02-26T12:20:08.352875+0000","last_clean":"2024-02-26T12:20:08.352875+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:08.352875+0000","last_undegraded":"2024-02-26T12:20:08.352875+0000","last_fullsized":"2024-02-26T12:20:08.352875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:04.810848+0000","last_clean_scrub_stamp":"2024-02-26T12:20:04.810848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:09:43.953392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:08.352681+0000","last_change":"2024-02-26T12:19:08.265564+0000","last_active":"2024-02-26T12:20:08.352681+0000","last_peered":"2024-02-26T12:20:08.352681+0000","last_clean":"2024-02-26T12:20:08.352681+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:08.352681+0000","last_undegraded":"2024-02-26T12:20:08.352681+0000","last_fullsized":"2024-02-26T12:20:08.352681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:19:07.222554+0000","last_clean_scrub_stamp":"2024-02-26T12:19:07.222554+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:08:01.961658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":141293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":141293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:27.891 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.891 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.891 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.891 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.892 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.893 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.894 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.895 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.896 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.897 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.898 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.899 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.900 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.901 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.902 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.903 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.904 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.905 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.906 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.906 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-02-26T12:20:05.814713+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=5, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.906 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-26T12:20:04.810848+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.906 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-26T12:19:07.222554+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=19, tm_sec=7, tm_wday=0, tm_yday=57, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=26, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=57, tm_isdst=0) 2024-02-26T12:20:27.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-26T12:20:47.908 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-26T12:20:48.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.036+0000 7fbb07fa3640 1 Processor -- start 2024-02-26T12:20:48.022 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.036+0000 7fbb07fa3640 1 -- start start 2024-02-26T12:20:48.023 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb07fa3640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbb0006d250 0x7fbb0015e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb07fa3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 0x7fbb0015c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb07fa3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0015eb60 con 0x7fbb000aed50 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb07fa3640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb000af130 con 0x7fbb0006d250 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb07fa3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0015ee40 con 0x7fbb0015bf80 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb0553e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbb0006d250 0x7fbb0015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb0553e640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbb0006d250 0x7fbb0015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55702/0 (socket says 172.21.15.113:55702) 2024-02-26T12:20:48.024 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb0553e640 1 -- 172.21.15.113:0/2325695821 learned_addr learned my addr 172.21.15.113:0/2325695821 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.037+0000 7fbb06540640 1 --2- 172.21.15.113:0/2325695821 >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 0x7fbb0015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb0553e640 1 -- 172.21.15.113:0/2325695821 >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 msgr2=0x7fbb0015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb0553e640 1 --2- 172.21.15.113:0/2325695821 >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 0x7fbb0015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb0553e640 1 -- 172.21.15.113:0/2325695821 >> v1:172.21.15.152:6789/0 conn(0x7fbb000aed50 legacy=0x7fbb000b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb0553e640 1 -- 172.21.15.113:0/2325695821 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0015f120 con 0x7fbb0006d250 2024-02-26T12:20:48.025 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb06540640 1 --2- 172.21.15.113:0/2325695821 >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 0x7fbb0015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:48.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb0553e640 1 --2- 172.21.15.113:0/2325695821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb0006d250 0x7fbb0015e460 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbb000cc3d0 tx=0x7fbaf002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a214214826dc2a41 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.038+0000 7fbb04d3d640 1 -- 172.21.15.113:0/2325695821 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0034070 con 0x7fbb0006d250 2024-02-26T12:20:48.028 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb04d3d640 1 -- 172.21.15.113:0/2325695821 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0030860 con 0x7fbb0006d250 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb04d3d640 1 -- 172.21.15.113:0/2325695821 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0030c30 con 0x7fbb0006d250 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 -- 172.21.15.113:0/2325695821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb0006d250 msgr2=0x7fbb0015e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/2325695821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb0006d250 0x7fbb0015e460 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbb000cc3d0 tx=0x7fbaf002b9a0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 -- 172.21.15.113:0/2325695821 shutdown_connections 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/2325695821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb0006d250 0x7fbb0015e460 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/2325695821 >> v2:172.21.15.152:3300/0 conn(0x7fbb0015bf80 0x7fbb0015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 -- 172.21.15.113:0/2325695821 >> 172.21.15.113:0/2325695821 conn(0x7fbb0006ab50 msgr2=0x7fbb0006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 -- 172.21.15.113:0/2325695821 shutdown_connections 2024-02-26T12:20:48.029 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.039+0000 7fbb07fa3640 1 -- 172.21.15.113:0/2325695821 wait complete. 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.040+0000 7fbb07fa3640 1 Processor -- start 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.040+0000 7fbb07fa3640 1 -- start start 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 0x7fbb000b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0015bf80 0x7fbb00151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b4050 con 0x7fbb000aed50 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b3420 con 0x7fbb0006d250 2024-02-26T12:20:48.030 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb07fa3640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b41d0 con 0x7fbb0015bf80 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb0553e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb0553e640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55706/0 (socket says 172.21.15.113:55706) 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb0553e640 1 -- 172.21.15.113:0/3957144027 learned_addr learned my addr 172.21.15.113:0/3957144027 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb05d3f640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 0x7fbb000b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb06540640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0015bf80 0x7fbb00151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb0553e640 1 -- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0015bf80 msgr2=0x7fbb00151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.041+0000 7fbb0553e640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0015bf80 0x7fbb00151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.031 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb0553e640 1 -- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 msgr2=0x7fbb000b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb0553e640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 0x7fbb000b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb0553e640 1 -- 172.21.15.113:0/3957144027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0015a1b0 con 0x7fbb000aed50 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb05d3f640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 0x7fbb000b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb0553e640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbaf002b9e0 tx=0x7fbaf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0048070 con 0x7fbb000aed50 2024-02-26T12:20:48.032 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0030660 con 0x7fbb000aed50 2024-02-26T12:20:48.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb00151fc0 con 0x7fbb000aed50 2024-02-26T12:20:48.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0034040 con 0x7fbb000aed50 2024-02-26T12:20:48.033 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.042+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0014edb0 con 0x7fbb000aed50 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.043+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb00074a50 con 0x7fbb000aed50 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.043+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbaf004b070 con 0x7fbb000aed50 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.044+0000 7fbaf67fc640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 0x7fbae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.044+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbaf00ac290 con 0x7fbb000aed50 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.044+0000 7fbb05d3f640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 0x7fbae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.034 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.044+0000 7fbb05d3f640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 0x7fbae406d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbafc001e00 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.035 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.048+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbaf007b080 con 0x7fbb000aed50 2024-02-26T12:20:48.210 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.224+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 --> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb000ccad0 con 0x7fbae406b4d0 2024-02-26T12:20:48.216 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.230+0000 7fbaf67fc640 1 -- 172.21.15.113:0/3957144027 <== mgr.4101 v2:172.21.15.113:6832/734952106 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251893 (secure 0 0 0) 0x7fbb000ccad0 con 0x7fbae406b4d0 2024-02-26T12:20:48.219 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:48.221 INFO:teuthology.orchestra.run.smithi113.stderr:dumped all 2024-02-26T12:20:48.224 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 msgr2=0x7fbae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 0x7fbae406d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbafc001e00 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 msgr2=0x7fbb00151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbaf002b9e0 tx=0x7fbaf0004730 comp rx=0 tx=0).stop 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 shutdown_connections 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fbae406b4d0 0x7fbae406d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbb0015bf80 0x7fbb00151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.225 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbb000aed50 0x7fbb00151450 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 --2- 172.21.15.113:0/3957144027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb0006d250 0x7fbb000b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 >> 172.21.15.113:0/3957144027 conn(0x7fbb0006ab50 msgr2=0x7fbb000cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 shutdown_connections 2024-02-26T12:20:48.226 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.234+0000 7fbb07fa3640 1 -- 172.21.15.113:0/3957144027 wait complete. 2024-02-26T12:20:48.230 INFO:teuthology.orchestra.run.smithi113.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-02-26T12:20:47.174519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220080,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754640,"statfs":{"total":773094113280,"available":772868751360,"internally_reserved":0,"allocated":4046848,"data_stored":2269630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":221236790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002955"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.265569+0000","last_change":"2024-02-26T12:20:33.265597+0000","last_active":"2024-02-26T12:20:33.265569+0000","last_peered":"2024-02-26T12:20:33.265569+0000","last_clean":"2024-02-26T12:20:33.265569+0000","last_became_active":"2024-02-26T12:20:06.844711+0000","last_became_peered":"2024-02-26T12:20:06.844711+0000","last_unstale":"2024-02-26T12:20:33.265569+0000","last_undegraded":"2024-02-26T12:20:33.265569+0000","last_fullsized":"2024-02-26T12:20:33.265569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.265465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.265465+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.265465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:53.877933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:36.330567+0000","last_change":"2024-02-26T12:20:36.330591+0000","last_active":"2024-02-26T12:20:36.330567+0000","last_peered":"2024-02-26T12:20:36.330567+0000","last_clean":"2024-02-26T12:20:36.330567+0000","last_became_active":"2024-02-26T12:20:06.848753+0000","last_became_peered":"2024-02-26T12:20:06.848753+0000","last_unstale":"2024-02-26T12:20:36.330567+0000","last_undegraded":"2024-02-26T12:20:36.330567+0000","last_fullsized":"2024-02-26T12:20:36.330567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:36.330473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:36.330473+0000","last_clean_scrub_stamp":"2024-02-26T12:20:36.330473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:13:36.853460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.769379+0000","last_change":"2024-02-26T12:20:31.769402+0000","last_active":"2024-02-26T12:20:31.769379+0000","last_peered":"2024-02-26T12:20:31.769379+0000","last_clean":"2024-02-26T12:20:31.769379+0000","last_became_active":"2024-02-26T12:20:06.834674+0000","last_became_peered":"2024-02-26T12:20:06.834674+0000","last_unstale":"2024-02-26T12:20:31.769379+0000","last_undegraded":"2024-02-26T12:20:31.769379+0000","last_fullsized":"2024-02-26T12:20:31.769379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.769261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.769261+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.769261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:30:57.674691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:37.281742+0000","last_change":"2024-02-26T12:20:37.281768+0000","last_active":"2024-02-26T12:20:37.281742+0000","last_peered":"2024-02-26T12:20:37.281742+0000","last_clean":"2024-02-26T12:20:37.281742+0000","last_became_active":"2024-02-26T12:20:06.852591+0000","last_became_peered":"2024-02-26T12:20:06.852591+0000","last_unstale":"2024-02-26T12:20:37.281742+0000","last_undegraded":"2024-02-26T12:20:37.281742+0000","last_fullsized":"2024-02-26T12:20:37.281742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:37.281647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:37.281647+0000","last_clean_scrub_stamp":"2024-02-26T12:20:37.281647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:43:11.545178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.451343+0000","last_change":"2024-02-26T12:20:34.451373+0000","last_active":"2024-02-26T12:20:34.451343+0000","last_peered":"2024-02-26T12:20:34.451343+0000","last_clean":"2024-02-26T12:20:34.451343+0000","last_became_active":"2024-02-26T12:20:06.851970+0000","last_became_peered":"2024-02-26T12:20:06.851970+0000","last_unstale":"2024-02-26T12:20:34.451343+0000","last_undegraded":"2024-02-26T12:20:34.451343+0000","last_fullsized":"2024-02-26T12:20:34.451343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.451246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.451246+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.451246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:50.063682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:38.402208+0000","last_change":"2024-02-26T12:20:38.402247+0000","last_active":"2024-02-26T12:20:38.402208+0000","last_peered":"2024-02-26T12:20:38.402208+0000","last_clean":"2024-02-26T12:20:38.402208+0000","last_became_active":"2024-02-26T12:20:06.848903+0000","last_became_peered":"2024-02-26T12:20:06.848903+0000","last_unstale":"2024-02-26T12:20:38.402208+0000","last_undegraded":"2024-02-26T12:20:38.402208+0000","last_fullsized":"2024-02-26T12:20:38.402208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:38.402113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:38.402113+0000","last_clean_scrub_stamp":"2024-02-26T12:20:38.402113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:21:53.082488+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.313190+0000","last_change":"2024-02-26T12:20:33.313213+0000","last_active":"2024-02-26T12:20:33.313190+0000","last_peered":"2024-02-26T12:20:33.313190+0000","last_clean":"2024-02-26T12:20:33.313190+0000","last_became_active":"2024-02-26T12:20:06.842744+0000","last_became_peered":"2024-02-26T12:20:06.842744+0000","last_unstale":"2024-02-26T12:20:33.313190+0000","last_undegraded":"2024-02-26T12:20:33.313190+0000","last_fullsized":"2024-02-26T12:20:33.313190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.313108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.313108+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.313108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:05:05.598896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.283760+0000","last_change":"2024-02-26T12:20:29.283786+0000","last_active":"2024-02-26T12:20:29.283760+0000","last_peered":"2024-02-26T12:20:29.283760+0000","last_clean":"2024-02-26T12:20:29.283760+0000","last_became_active":"2024-02-26T12:20:06.839487+0000","last_became_peered":"2024-02-26T12:20:06.839487+0000","last_unstale":"2024-02-26T12:20:29.283760+0000","last_undegraded":"2024-02-26T12:20:29.283760+0000","last_fullsized":"2024-02-26T12:20:29.283760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.283643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.283643+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.283643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:03:32.790568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:38.334379+0000","last_change":"2024-02-26T12:20:38.334406+0000","last_active":"2024-02-26T12:20:38.334379+0000","last_peered":"2024-02-26T12:20:38.334379+0000","last_clean":"2024-02-26T12:20:38.334379+0000","last_became_active":"2024-02-26T12:20:06.848478+0000","last_became_peered":"2024-02-26T12:20:06.848478+0000","last_unstale":"2024-02-26T12:20:38.334379+0000","last_undegraded":"2024-02-26T12:20:38.334379+0000","last_fullsized":"2024-02-26T12:20:38.334379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:38.334281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:38.334281+0000","last_clean_scrub_stamp":"2024-02-26T12:20:38.334281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:12:26.232506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.323174+0000","last_change":"2024-02-26T12:20:34.323203+0000","last_active":"2024-02-26T12:20:34.323174+0000","last_peered":"2024-02-26T12:20:34.323174+0000","last_clean":"2024-02-26T12:20:34.323174+0000","last_became_active":"2024-02-26T12:20:06.850042+0000","last_became_peered":"2024-02-26T12:20:06.850042+0000","last_unstale":"2024-02-26T12:20:34.323174+0000","last_undegraded":"2024-02-26T12:20:34.323174+0000","last_fullsized":"2024-02-26T12:20:34.323174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.323076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.323076+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.323076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:27.532411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:38.327244+0000","last_change":"2024-02-26T12:20:38.327268+0000","last_active":"2024-02-26T12:20:38.327244+0000","last_peered":"2024-02-26T12:20:38.327244+0000","last_clean":"2024-02-26T12:20:38.327244+0000","last_became_active":"2024-02-26T12:20:06.845212+0000","last_became_peered":"2024-02-26T12:20:06.845212+0000","last_unstale":"2024-02-26T12:20:38.327244+0000","last_undegraded":"2024-02-26T12:20:38.327244+0000","last_fullsized":"2024-02-26T12:20:38.327244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:38.327135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:38.327135+0000","last_clean_scrub_stamp":"2024-02-26T12:20:38.327135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:13:38.850122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:37.847353+0000","last_change":"2024-02-26T12:20:37.847381+0000","last_active":"2024-02-26T12:20:37.847353+0000","last_peered":"2024-02-26T12:20:37.847353+0000","last_clean":"2024-02-26T12:20:37.847353+0000","last_became_active":"2024-02-26T12:20:06.850464+0000","last_became_peered":"2024-02-26T12:20:06.850464+0000","last_unstale":"2024-02-26T12:20:37.847353+0000","last_undegraded":"2024-02-26T12:20:37.847353+0000","last_fullsized":"2024-02-26T12:20:37.847353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:37.847251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:37.847251+0000","last_clean_scrub_stamp":"2024-02-26T12:20:37.847251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:57:14.138774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.381565+0000","last_change":"2024-02-26T12:20:31.381592+0000","last_active":"2024-02-26T12:20:31.381565+0000","last_peered":"2024-02-26T12:20:31.381565+0000","last_clean":"2024-02-26T12:20:31.381565+0000","last_became_active":"2024-02-26T12:20:06.844852+0000","last_became_peered":"2024-02-26T12:20:06.844852+0000","last_unstale":"2024-02-26T12:20:31.381565+0000","last_undegraded":"2024-02-26T12:20:31.381565+0000","last_fullsized":"2024-02-26T12:20:31.381565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.381471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.381471+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.381471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:50:06.551804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:35.332438+0000","last_change":"2024-02-26T12:20:35.332472+0000","last_active":"2024-02-26T12:20:35.332438+0000","last_peered":"2024-02-26T12:20:35.332438+0000","last_clean":"2024-02-26T12:20:35.332438+0000","last_became_active":"2024-02-26T12:20:06.848517+0000","last_became_peered":"2024-02-26T12:20:06.848517+0000","last_unstale":"2024-02-26T12:20:35.332438+0000","last_undegraded":"2024-02-26T12:20:35.332438+0000","last_fullsized":"2024-02-26T12:20:35.332438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:35.332315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:35.332315+0000","last_clean_scrub_stamp":"2024-02-26T12:20:35.332315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:41:09.943851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.731168+0000","last_change":"2024-02-26T12:20:34.731196+0000","last_active":"2024-02-26T12:20:34.731168+0000","last_peered":"2024-02-26T12:20:34.731168+0000","last_clean":"2024-02-26T12:20:34.731168+0000","last_became_active":"2024-02-26T12:20:06.843388+0000","last_became_peered":"2024-02-26T12:20:06.843388+0000","last_unstale":"2024-02-26T12:20:34.731168+0000","last_undegraded":"2024-02-26T12:20:34.731168+0000","last_fullsized":"2024-02-26T12:20:34.731168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.731080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.731080+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.731080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:12:22.629305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:39.354717+0000","last_change":"2024-02-26T12:20:39.354741+0000","last_active":"2024-02-26T12:20:39.354717+0000","last_peered":"2024-02-26T12:20:39.354717+0000","last_clean":"2024-02-26T12:20:39.354717+0000","last_became_active":"2024-02-26T12:20:06.850170+0000","last_became_peered":"2024-02-26T12:20:06.850170+0000","last_unstale":"2024-02-26T12:20:39.354717+0000","last_undegraded":"2024-02-26T12:20:39.354717+0000","last_fullsized":"2024-02-26T12:20:39.354717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:39.354622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:39.354622+0000","last_clean_scrub_stamp":"2024-02-26T12:20:39.354622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:44.001979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.349188+0000","last_change":"2024-02-26T12:20:34.349244+0000","last_active":"2024-02-26T12:20:34.349188+0000","last_peered":"2024-02-26T12:20:34.349188+0000","last_clean":"2024-02-26T12:20:34.349188+0000","last_became_active":"2024-02-26T12:20:06.845628+0000","last_became_peered":"2024-02-26T12:20:06.845628+0000","last_unstale":"2024-02-26T12:20:34.349188+0000","last_undegraded":"2024-02-26T12:20:34.349188+0000","last_fullsized":"2024-02-26T12:20:34.349188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.349090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.349090+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.349090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:06:03.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:26.417310+0000","last_change":"2024-02-26T12:20:26.417331+0000","last_active":"2024-02-26T12:20:26.417310+0000","last_peered":"2024-02-26T12:20:26.417310+0000","last_clean":"2024-02-26T12:20:26.417310+0000","last_became_active":"2024-02-26T12:20:06.848504+0000","last_became_peered":"2024-02-26T12:20:06.848504+0000","last_unstale":"2024-02-26T12:20:26.417310+0000","last_undegraded":"2024-02-26T12:20:26.417310+0000","last_fullsized":"2024-02-26T12:20:26.417310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:26.417234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:26.417234+0000","last_clean_scrub_stamp":"2024-02-26T12:20:26.417234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:13:11.268811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:42.332727+0000","last_change":"2024-02-26T12:20:42.332753+0000","last_active":"2024-02-26T12:20:42.332727+0000","last_peered":"2024-02-26T12:20:42.332727+0000","last_clean":"2024-02-26T12:20:42.332727+0000","last_became_active":"2024-02-26T12:20:06.854001+0000","last_became_peered":"2024-02-26T12:20:06.854001+0000","last_unstale":"2024-02-26T12:20:42.332727+0000","last_undegraded":"2024-02-26T12:20:42.332727+0000","last_fullsized":"2024-02-26T12:20:42.332727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:42.332629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:42.332629+0000","last_clean_scrub_stamp":"2024-02-26T12:20:42.332629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:10:46.687690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.404631+0000","last_change":"2024-02-26T12:20:33.404652+0000","last_active":"2024-02-26T12:20:33.404631+0000","last_peered":"2024-02-26T12:20:33.404631+0000","last_clean":"2024-02-26T12:20:33.404631+0000","last_became_active":"2024-02-26T12:20:06.847463+0000","last_became_peered":"2024-02-26T12:20:06.847463+0000","last_unstale":"2024-02-26T12:20:33.404631+0000","last_undegraded":"2024-02-26T12:20:33.404631+0000","last_fullsized":"2024-02-26T12:20:33.404631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.404549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.404549+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.404549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:19.186961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:35.382300+0000","last_change":"2024-02-26T12:20:35.382325+0000","last_active":"2024-02-26T12:20:35.382300+0000","last_peered":"2024-02-26T12:20:35.382300+0000","last_clean":"2024-02-26T12:20:35.382300+0000","last_became_active":"2024-02-26T12:20:06.835148+0000","last_became_peered":"2024-02-26T12:20:06.835148+0000","last_unstale":"2024-02-26T12:20:35.382300+0000","last_undegraded":"2024-02-26T12:20:35.382300+0000","last_fullsized":"2024-02-26T12:20:35.382300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:35.382214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:35.382214+0000","last_clean_scrub_stamp":"2024-02-26T12:20:35.382214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:08:22.619397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:40.318651+0000","last_change":"2024-02-26T12:20:40.318679+0000","last_active":"2024-02-26T12:20:40.318651+0000","last_peered":"2024-02-26T12:20:40.318651+0000","last_clean":"2024-02-26T12:20:40.318651+0000","last_became_active":"2024-02-26T12:20:06.849417+0000","last_became_peered":"2024-02-26T12:20:06.849417+0000","last_unstale":"2024-02-26T12:20:40.318651+0000","last_undegraded":"2024-02-26T12:20:40.318651+0000","last_fullsized":"2024-02-26T12:20:40.318651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:40.318547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:40.318547+0000","last_clean_scrub_stamp":"2024-02-26T12:20:40.318547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:41:14.930084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.361709+0000","last_change":"2024-02-26T12:20:32.361732+0000","last_active":"2024-02-26T12:20:32.361709+0000","last_peered":"2024-02-26T12:20:32.361709+0000","last_clean":"2024-02-26T12:20:32.361709+0000","last_became_active":"2024-02-26T12:20:06.839715+0000","last_became_peered":"2024-02-26T12:20:06.839715+0000","last_unstale":"2024-02-26T12:20:32.361709+0000","last_undegraded":"2024-02-26T12:20:32.361709+0000","last_fullsized":"2024-02-26T12:20:32.361709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.361576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.361576+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.361576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:40:15.167665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.774362+0000","last_change":"2024-02-26T12:20:33.774388+0000","last_active":"2024-02-26T12:20:33.774362+0000","last_peered":"2024-02-26T12:20:33.774362+0000","last_clean":"2024-02-26T12:20:33.774362+0000","last_became_active":"2024-02-26T12:20:06.836822+0000","last_became_peered":"2024-02-26T12:20:06.836822+0000","last_unstale":"2024-02-26T12:20:33.774362+0000","last_undegraded":"2024-02-26T12:20:33.774362+0000","last_fullsized":"2024-02-26T12:20:33.774362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.774267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.774267+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.774267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:05:12.765993+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.324895+0000","last_change":"2024-02-26T12:20:33.324920+0000","last_active":"2024-02-26T12:20:33.324895+0000","last_peered":"2024-02-26T12:20:33.324895+0000","last_clean":"2024-02-26T12:20:33.324895+0000","last_became_active":"2024-02-26T12:20:06.844578+0000","last_became_peered":"2024-02-26T12:20:06.844578+0000","last_unstale":"2024-02-26T12:20:33.324895+0000","last_undegraded":"2024-02-26T12:20:33.324895+0000","last_fullsized":"2024-02-26T12:20:33.324895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.324797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.324797+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.324797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:30:59.230227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.333196+0000","last_change":"2024-02-26T12:20:34.333227+0000","last_active":"2024-02-26T12:20:34.333196+0000","last_peered":"2024-02-26T12:20:34.333196+0000","last_clean":"2024-02-26T12:20:34.333196+0000","last_became_active":"2024-02-26T12:20:06.848462+0000","last_became_peered":"2024-02-26T12:20:06.848462+0000","last_unstale":"2024-02-26T12:20:34.333196+0000","last_undegraded":"2024-02-26T12:20:34.333196+0000","last_fullsized":"2024-02-26T12:20:34.333196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.333108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.333108+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.333108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:43:08.596639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:36.281582+0000","last_change":"2024-02-26T12:20:36.281610+0000","last_active":"2024-02-26T12:20:36.281582+0000","last_peered":"2024-02-26T12:20:36.281582+0000","last_clean":"2024-02-26T12:20:36.281582+0000","last_became_active":"2024-02-26T12:20:06.851324+0000","last_became_peered":"2024-02-26T12:20:06.851324+0000","last_unstale":"2024-02-26T12:20:36.281582+0000","last_undegraded":"2024-02-26T12:20:36.281582+0000","last_fullsized":"2024-02-26T12:20:36.281582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:36.281488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:36.281488+0000","last_clean_scrub_stamp":"2024-02-26T12:20:36.281488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T17:12:24.179713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.739664+0000","last_change":"2024-02-26T12:20:29.739706+0000","last_active":"2024-02-26T12:20:29.739664+0000","last_peered":"2024-02-26T12:20:29.739664+0000","last_clean":"2024-02-26T12:20:29.739664+0000","last_became_active":"2024-02-26T12:20:06.834102+0000","last_became_peered":"2024-02-26T12:20:06.834102+0000","last_unstale":"2024-02-26T12:20:29.739664+0000","last_undegraded":"2024-02-26T12:20:29.739664+0000","last_fullsized":"2024-02-26T12:20:29.739664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.739561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.739561+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.739561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:15.943480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:42.352111+0000","last_change":"2024-02-26T12:20:42.352135+0000","last_active":"2024-02-26T12:20:42.352111+0000","last_peered":"2024-02-26T12:20:42.352111+0000","last_clean":"2024-02-26T12:20:42.352111+0000","last_became_active":"2024-02-26T12:20:06.851322+0000","last_became_peered":"2024-02-26T12:20:06.851322+0000","last_unstale":"2024-02-26T12:20:42.352111+0000","last_undegraded":"2024-02-26T12:20:42.352111+0000","last_fullsized":"2024-02-26T12:20:42.352111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:42.351997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:42.351997+0000","last_clean_scrub_stamp":"2024-02-26T12:20:42.351997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:00:57.002441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.287114+0000","last_change":"2024-02-26T12:20:31.287159+0000","last_active":"2024-02-26T12:20:31.287114+0000","last_peered":"2024-02-26T12:20:31.287114+0000","last_clean":"2024-02-26T12:20:31.287114+0000","last_became_active":"2024-02-26T12:20:06.840466+0000","last_became_peered":"2024-02-26T12:20:06.840466+0000","last_unstale":"2024-02-26T12:20:31.287114+0000","last_undegraded":"2024-02-26T12:20:31.287114+0000","last_fullsized":"2024-02-26T12:20:31.287114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.286996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.286996+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.286996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:28:18.566702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.279229+0000","last_change":"2024-02-26T12:20:34.279255+0000","last_active":"2024-02-26T12:20:34.279229+0000","last_peered":"2024-02-26T12:20:34.279229+0000","last_clean":"2024-02-26T12:20:34.279229+0000","last_became_active":"2024-02-26T12:20:06.848389+0000","last_became_peered":"2024-02-26T12:20:06.848389+0000","last_unstale":"2024-02-26T12:20:34.279229+0000","last_undegraded":"2024-02-26T12:20:34.279229+0000","last_fullsized":"2024-02-26T12:20:34.279229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:34.279135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:34.279135+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.279135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:54.053559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:37.277131+0000","last_change":"2024-02-26T12:20:37.277162+0000","last_active":"2024-02-26T12:20:37.277131+0000","last_peered":"2024-02-26T12:20:37.277131+0000","last_clean":"2024-02-26T12:20:37.277131+0000","last_became_active":"2024-02-26T12:20:06.846252+0000","last_became_peered":"2024-02-26T12:20:06.846252+0000","last_unstale":"2024-02-26T12:20:37.277131+0000","last_undegraded":"2024-02-26T12:20:37.277131+0000","last_fullsized":"2024-02-26T12:20:37.277131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:37.277030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:37.277030+0000","last_clean_scrub_stamp":"2024-02-26T12:20:37.277030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:41:11.888567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.405379+0000","last_change":"2024-02-26T12:20:30.405403+0000","last_active":"2024-02-26T12:20:30.405379+0000","last_peered":"2024-02-26T12:20:30.405379+0000","last_clean":"2024-02-26T12:20:30.405379+0000","last_became_active":"2024-02-26T12:20:06.838828+0000","last_became_peered":"2024-02-26T12:20:06.838828+0000","last_unstale":"2024-02-26T12:20:30.405379+0000","last_undegraded":"2024-02-26T12:20:30.405379+0000","last_fullsized":"2024-02-26T12:20:30.405379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.405292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.405292+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.405292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:18:04.996254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.316894+0000","last_change":"2024-02-26T12:20:29.316924+0000","last_active":"2024-02-26T12:20:29.316894+0000","last_peered":"2024-02-26T12:20:29.316894+0000","last_clean":"2024-02-26T12:20:29.316894+0000","last_became_active":"2024-02-26T12:20:05.848255+0000","last_became_peered":"2024-02-26T12:20:05.848255+0000","last_unstale":"2024-02-26T12:20:29.316894+0000","last_undegraded":"2024-02-26T12:20:29.316894+0000","last_fullsized":"2024-02-26T12:20:29.316894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-26T12:20:29.316805+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-26T12:20:29.316805+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.316805+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:04:36.407219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.335396+0000","last_change":"2024-02-26T12:20:31.335419+0000","last_active":"2024-02-26T12:20:31.335396+0000","last_peered":"2024-02-26T12:20:31.335396+0000","last_clean":"2024-02-26T12:20:31.335396+0000","last_became_active":"2024-02-26T12:20:06.844011+0000","last_became_peered":"2024-02-26T12:20:06.844011+0000","last_unstale":"2024-02-26T12:20:31.335396+0000","last_undegraded":"2024-02-26T12:20:31.335396+0000","last_fullsized":"2024-02-26T12:20:31.335396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.335325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.335325+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.335325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:18:05.926287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.402347+0000","last_change":"2024-02-26T12:20:28.402385+0000","last_active":"2024-02-26T12:20:28.402347+0000","last_peered":"2024-02-26T12:20:28.402347+0000","last_clean":"2024-02-26T12:20:28.402347+0000","last_became_active":"2024-02-26T12:20:05.841574+0000","last_became_peered":"2024-02-26T12:20:05.841574+0000","last_unstale":"2024-02-26T12:20:28.402347+0000","last_undegraded":"2024-02-26T12:20:28.402347+0000","last_fullsized":"2024-02-26T12:20:28.402347+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-02-26T12:20:28.402218+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-02-26T12:20:28.402218+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.402218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:34:14.184630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:41.366047+0000","last_change":"2024-02-26T12:20:41.366079+0000","last_active":"2024-02-26T12:20:41.366047+0000","last_peered":"2024-02-26T12:20:41.366047+0000","last_clean":"2024-02-26T12:20:41.366047+0000","last_became_active":"2024-02-26T12:20:06.850197+0000","last_became_peered":"2024-02-26T12:20:06.850197+0000","last_unstale":"2024-02-26T12:20:41.366047+0000","last_undegraded":"2024-02-26T12:20:41.366047+0000","last_fullsized":"2024-02-26T12:20:41.366047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:41.365934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:41.365934+0000","last_clean_scrub_stamp":"2024-02-26T12:20:41.365934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:57:17.657457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.350849+0000","last_change":"2024-02-26T12:20:32.350899+0000","last_active":"2024-02-26T12:20:32.350849+0000","last_peered":"2024-02-26T12:20:32.350849+0000","last_clean":"2024-02-26T12:20:32.350849+0000","last_became_active":"2024-02-26T12:20:05.843214+0000","last_became_peered":"2024-02-26T12:20:05.843214+0000","last_unstale":"2024-02-26T12:20:32.350849+0000","last_undegraded":"2024-02-26T12:20:32.350849+0000","last_fullsized":"2024-02-26T12:20:32.350849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:32.350734+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:32.350734+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.350734+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:06:01.308042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.321939+0000","last_change":"2024-02-26T12:20:31.321969+0000","last_active":"2024-02-26T12:20:31.321939+0000","last_peered":"2024-02-26T12:20:31.321939+0000","last_clean":"2024-02-26T12:20:31.321939+0000","last_became_active":"2024-02-26T12:20:06.838990+0000","last_became_peered":"2024-02-26T12:20:06.838990+0000","last_unstale":"2024-02-26T12:20:31.321939+0000","last_undegraded":"2024-02-26T12:20:31.321939+0000","last_fullsized":"2024-02-26T12:20:31.321939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.321827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.321827+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.321827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:17.525746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:26.334856+0000","last_change":"2024-02-26T12:20:26.334879+0000","last_active":"2024-02-26T12:20:26.334856+0000","last_peered":"2024-02-26T12:20:26.334856+0000","last_clean":"2024-02-26T12:20:26.334856+0000","last_became_active":"2024-02-26T12:20:05.833190+0000","last_became_peered":"2024-02-26T12:20:05.833190+0000","last_unstale":"2024-02-26T12:20:26.334856+0000","last_undegraded":"2024-02-26T12:20:26.334856+0000","last_fullsized":"2024-02-26T12:20:26.334856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:26.334768+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:26.334768+0000","last_clean_scrub_stamp":"2024-02-26T12:20:26.334768+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:58:40.121410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:36.310588+0000","last_change":"2024-02-26T12:20:36.310620+0000","last_active":"2024-02-26T12:20:36.310588+0000","last_peered":"2024-02-26T12:20:36.310588+0000","last_clean":"2024-02-26T12:20:36.310588+0000","last_became_active":"2024-02-26T12:20:06.845596+0000","last_became_peered":"2024-02-26T12:20:06.845596+0000","last_unstale":"2024-02-26T12:20:36.310588+0000","last_undegraded":"2024-02-26T12:20:36.310588+0000","last_fullsized":"2024-02-26T12:20:36.310588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:36.310489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:36.310489+0000","last_clean_scrub_stamp":"2024-02-26T12:20:36.310489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:43:10.574020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:26.356417+0000","last_change":"2024-02-26T12:20:26.356446+0000","last_active":"2024-02-26T12:20:26.356417+0000","last_peered":"2024-02-26T12:20:26.356417+0000","last_clean":"2024-02-26T12:20:26.356417+0000","last_became_active":"2024-02-26T12:20:05.847094+0000","last_became_peered":"2024-02-26T12:20:05.847094+0000","last_unstale":"2024-02-26T12:20:26.356417+0000","last_undegraded":"2024-02-26T12:20:26.356417+0000","last_fullsized":"2024-02-26T12:20:26.356417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-02-26T12:20:26.356304+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-02-26T12:20:26.356304+0000","last_clean_scrub_stamp":"2024-02-26T12:20:26.356304+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:51:12.721610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.735007+0000","last_change":"2024-02-26T12:20:32.735034+0000","last_active":"2024-02-26T12:20:32.735007+0000","last_peered":"2024-02-26T12:20:32.735007+0000","last_clean":"2024-02-26T12:20:32.735007+0000","last_became_active":"2024-02-26T12:20:06.835459+0000","last_became_peered":"2024-02-26T12:20:06.835459+0000","last_unstale":"2024-02-26T12:20:32.735007+0000","last_undegraded":"2024-02-26T12:20:32.735007+0000","last_fullsized":"2024-02-26T12:20:32.735007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.734901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.734901+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.734901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:51:25.944235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.333168+0000","last_change":"2024-02-26T12:20:31.333193+0000","last_active":"2024-02-26T12:20:31.333168+0000","last_peered":"2024-02-26T12:20:31.333168+0000","last_clean":"2024-02-26T12:20:31.333168+0000","last_became_active":"2024-02-26T12:20:05.844780+0000","last_became_peered":"2024-02-26T12:20:05.844780+0000","last_unstale":"2024-02-26T12:20:31.333168+0000","last_undegraded":"2024-02-26T12:20:31.333168+0000","last_fullsized":"2024-02-26T12:20:31.333168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-02-26T12:20:31.333090+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-02-26T12:20:31.333090+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.333090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:13:16.184667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:37.358311+0000","last_change":"2024-02-26T12:20:37.358338+0000","last_active":"2024-02-26T12:20:37.358311+0000","last_peered":"2024-02-26T12:20:37.358311+0000","last_clean":"2024-02-26T12:20:37.358311+0000","last_became_active":"2024-02-26T12:20:06.840062+0000","last_became_peered":"2024-02-26T12:20:06.840062+0000","last_unstale":"2024-02-26T12:20:37.358311+0000","last_undegraded":"2024-02-26T12:20:37.358311+0000","last_fullsized":"2024-02-26T12:20:37.358311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:37.358223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:37.358223+0000","last_clean_scrub_stamp":"2024-02-26T12:20:37.358223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:05:16.349949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.393503+0000","last_change":"2024-02-26T12:20:27.393548+0000","last_active":"2024-02-26T12:20:27.393503+0000","last_peered":"2024-02-26T12:20:27.393503+0000","last_clean":"2024-02-26T12:20:27.393503+0000","last_became_active":"2024-02-26T12:20:05.838688+0000","last_became_peered":"2024-02-26T12:20:05.838688+0000","last_unstale":"2024-02-26T12:20:27.393503+0000","last_undegraded":"2024-02-26T12:20:27.393503+0000","last_fullsized":"2024-02-26T12:20:27.393503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:27.393410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:27.393410+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.393410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:56:04.142091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.351346+0000","last_change":"2024-02-26T12:20:30.351381+0000","last_active":"2024-02-26T12:20:30.351346+0000","last_peered":"2024-02-26T12:20:30.351346+0000","last_clean":"2024-02-26T12:20:30.351346+0000","last_became_active":"2024-02-26T12:20:06.838377+0000","last_became_peered":"2024-02-26T12:20:06.838377+0000","last_unstale":"2024-02-26T12:20:30.351346+0000","last_undegraded":"2024-02-26T12:20:30.351346+0000","last_fullsized":"2024-02-26T12:20:30.351346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.351252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.351252+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.351252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:03:33.858176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.283315+0000","last_change":"2024-02-26T12:20:30.283373+0000","last_active":"2024-02-26T12:20:30.283315+0000","last_peered":"2024-02-26T12:20:30.283315+0000","last_clean":"2024-02-26T12:20:30.283315+0000","last_became_active":"2024-02-26T12:20:05.843046+0000","last_became_peered":"2024-02-26T12:20:05.843046+0000","last_unstale":"2024-02-26T12:20:30.283315+0000","last_undegraded":"2024-02-26T12:20:30.283315+0000","last_fullsized":"2024-02-26T12:20:30.283315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.283195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.283195+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.283195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:41:30.313146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:38.805230+0000","last_change":"2024-02-26T12:20:38.805259+0000","last_active":"2024-02-26T12:20:38.805230+0000","last_peered":"2024-02-26T12:20:38.805230+0000","last_clean":"2024-02-26T12:20:38.805230+0000","last_became_active":"2024-02-26T12:20:06.851393+0000","last_became_peered":"2024-02-26T12:20:06.851393+0000","last_unstale":"2024-02-26T12:20:38.805230+0000","last_undegraded":"2024-02-26T12:20:38.805230+0000","last_fullsized":"2024-02-26T12:20:38.805230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:38.805124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:38.805124+0000","last_clean_scrub_stamp":"2024-02-26T12:20:38.805124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-28T00:00:53.455568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.409531+0000","last_change":"2024-02-26T12:20:30.409569+0000","last_active":"2024-02-26T12:20:30.409531+0000","last_peered":"2024-02-26T12:20:30.409531+0000","last_clean":"2024-02-26T12:20:30.409531+0000","last_became_active":"2024-02-26T12:20:05.842980+0000","last_became_peered":"2024-02-26T12:20:05.842980+0000","last_unstale":"2024-02-26T12:20:30.409531+0000","last_undegraded":"2024-02-26T12:20:30.409531+0000","last_fullsized":"2024-02-26T12:20:30.409531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.409418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.409418+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.409418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:08:17.646602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:41.363580+0000","last_change":"2024-02-26T12:20:41.363605+0000","last_active":"2024-02-26T12:20:41.363580+0000","last_peered":"2024-02-26T12:20:41.363580+0000","last_clean":"2024-02-26T12:20:41.363580+0000","last_became_active":"2024-02-26T12:20:06.852092+0000","last_became_peered":"2024-02-26T12:20:06.852092+0000","last_unstale":"2024-02-26T12:20:41.363580+0000","last_undegraded":"2024-02-26T12:20:41.363580+0000","last_fullsized":"2024-02-26T12:20:41.363580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:41.363474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:41.363474+0000","last_clean_scrub_stamp":"2024-02-26T12:20:41.363474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:31:34.121757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.436705+0000","last_change":"2024-02-26T12:20:29.436729+0000","last_active":"2024-02-26T12:20:29.436705+0000","last_peered":"2024-02-26T12:20:29.436705+0000","last_clean":"2024-02-26T12:20:29.436705+0000","last_became_active":"2024-02-26T12:20:05.844722+0000","last_became_peered":"2024-02-26T12:20:05.844722+0000","last_unstale":"2024-02-26T12:20:29.436705+0000","last_undegraded":"2024-02-26T12:20:29.436705+0000","last_fullsized":"2024-02-26T12:20:29.436705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.436606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.436606+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.436606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:27:45.049043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:37.375824+0000","last_change":"2024-02-26T12:20:37.375850+0000","last_active":"2024-02-26T12:20:37.375824+0000","last_peered":"2024-02-26T12:20:37.375824+0000","last_clean":"2024-02-26T12:20:37.375824+0000","last_became_active":"2024-02-26T12:20:06.848824+0000","last_became_peered":"2024-02-26T12:20:06.848824+0000","last_unstale":"2024-02-26T12:20:37.375824+0000","last_undegraded":"2024-02-26T12:20:37.375824+0000","last_fullsized":"2024-02-26T12:20:37.375824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:37.375727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:37.375727+0000","last_clean_scrub_stamp":"2024-02-26T12:20:37.375727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:10:42.023084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.719474+0000","last_change":"2024-02-26T12:20:28.719516+0000","last_active":"2024-02-26T12:20:28.719474+0000","last_peered":"2024-02-26T12:20:28.719474+0000","last_clean":"2024-02-26T12:20:28.719474+0000","last_became_active":"2024-02-26T12:20:05.838593+0000","last_became_peered":"2024-02-26T12:20:05.838593+0000","last_unstale":"2024-02-26T12:20:28.719474+0000","last_undegraded":"2024-02-26T12:20:28.719474+0000","last_fullsized":"2024-02-26T12:20:28.719474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-26T12:20:28.719367+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-26T12:20:28.719367+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.719367+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:03:32.226292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.753103+0000","last_change":"2024-02-26T12:20:30.753126+0000","last_active":"2024-02-26T12:20:30.753103+0000","last_peered":"2024-02-26T12:20:30.753103+0000","last_clean":"2024-02-26T12:20:30.753103+0000","last_became_active":"2024-02-26T12:20:06.834137+0000","last_became_peered":"2024-02-26T12:20:06.834137+0000","last_unstale":"2024-02-26T12:20:30.753103+0000","last_undegraded":"2024-02-26T12:20:30.753103+0000","last_fullsized":"2024-02-26T12:20:30.753103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.753010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.753010+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.753010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:59:42.349788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'10","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.344414+0000","last_change":"2024-02-26T12:20:33.344482+0000","last_active":"2024-02-26T12:20:33.344414+0000","last_peered":"2024-02-26T12:20:33.344414+0000","last_clean":"2024-02-26T12:20:33.344414+0000","last_became_active":"2024-02-26T12:20:05.844587+0000","last_became_peered":"2024-02-26T12:20:05.844587+0000","last_unstale":"2024-02-26T12:20:33.344414+0000","last_undegraded":"2024-02-26T12:20:33.344414+0000","last_fullsized":"2024-02-26T12:20:33.344414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-02-26T12:20:33.344319+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-02-26T12:20:33.344319+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.344319+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:56:30.011637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.303415+0000","last_change":"2024-02-26T12:20:32.303437+0000","last_active":"2024-02-26T12:20:32.303415+0000","last_peered":"2024-02-26T12:20:32.303415+0000","last_clean":"2024-02-26T12:20:32.303415+0000","last_became_active":"2024-02-26T12:20:06.841709+0000","last_became_peered":"2024-02-26T12:20:06.841709+0000","last_unstale":"2024-02-26T12:20:32.303415+0000","last_undegraded":"2024-02-26T12:20:32.303415+0000","last_fullsized":"2024-02-26T12:20:32.303415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.303319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.303319+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.303319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:59:43.900097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.391388+0000","last_change":"2024-02-26T12:20:33.391423+0000","last_active":"2024-02-26T12:20:33.391388+0000","last_peered":"2024-02-26T12:20:33.391388+0000","last_clean":"2024-02-26T12:20:33.391388+0000","last_became_active":"2024-02-26T12:20:05.845515+0000","last_became_peered":"2024-02-26T12:20:05.845515+0000","last_unstale":"2024-02-26T12:20:33.391388+0000","last_undegraded":"2024-02-26T12:20:33.391388+0000","last_fullsized":"2024-02-26T12:20:33.391388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:33.391291+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:33.391291+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.391291+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:43:14.449895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:39.362912+0000","last_change":"2024-02-26T12:20:39.362961+0000","last_active":"2024-02-26T12:20:39.362912+0000","last_peered":"2024-02-26T12:20:39.362912+0000","last_clean":"2024-02-26T12:20:39.362912+0000","last_became_active":"2024-02-26T12:20:06.849391+0000","last_became_peered":"2024-02-26T12:20:06.849391+0000","last_unstale":"2024-02-26T12:20:39.362912+0000","last_undegraded":"2024-02-26T12:20:39.362912+0000","last_fullsized":"2024-02-26T12:20:39.362912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:39.362796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:39.362796+0000","last_clean_scrub_stamp":"2024-02-26T12:20:39.362796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:05:06.351981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.370900+0000","last_change":"2024-02-26T12:20:29.370940+0000","last_active":"2024-02-26T12:20:29.370900+0000","last_peered":"2024-02-26T12:20:29.370900+0000","last_clean":"2024-02-26T12:20:29.370900+0000","last_became_active":"2024-02-26T12:20:05.846115+0000","last_became_peered":"2024-02-26T12:20:05.846115+0000","last_unstale":"2024-02-26T12:20:29.370900+0000","last_undegraded":"2024-02-26T12:20:29.370900+0000","last_fullsized":"2024-02-26T12:20:29.370900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.370810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.370810+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.370810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T23:13:14.222388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:35.346603+0000","last_change":"2024-02-26T12:20:35.346628+0000","last_active":"2024-02-26T12:20:35.346603+0000","last_peered":"2024-02-26T12:20:35.346603+0000","last_clean":"2024-02-26T12:20:35.346603+0000","last_became_active":"2024-02-26T12:20:06.845667+0000","last_became_peered":"2024-02-26T12:20:06.845667+0000","last_unstale":"2024-02-26T12:20:35.346603+0000","last_undegraded":"2024-02-26T12:20:35.346603+0000","last_fullsized":"2024-02-26T12:20:35.346603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:35.346503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:35.346503+0000","last_clean_scrub_stamp":"2024-02-26T12:20:35.346503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:56:32.013821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.392308+0000","last_change":"2024-02-26T12:20:31.392332+0000","last_active":"2024-02-26T12:20:31.392308+0000","last_peered":"2024-02-26T12:20:31.392308+0000","last_clean":"2024-02-26T12:20:31.392308+0000","last_became_active":"2024-02-26T12:20:05.842998+0000","last_became_peered":"2024-02-26T12:20:05.842998+0000","last_unstale":"2024-02-26T12:20:31.392308+0000","last_undegraded":"2024-02-26T12:20:31.392308+0000","last_fullsized":"2024-02-26T12:20:31.392308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.392213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.392213+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.392213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:05:03.678001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.305572+0000","last_change":"2024-02-26T12:20:32.305598+0000","last_active":"2024-02-26T12:20:32.305572+0000","last_peered":"2024-02-26T12:20:32.305572+0000","last_clean":"2024-02-26T12:20:32.305572+0000","last_became_active":"2024-02-26T12:20:06.843992+0000","last_became_peered":"2024-02-26T12:20:06.843992+0000","last_unstale":"2024-02-26T12:20:32.305572+0000","last_undegraded":"2024-02-26T12:20:32.305572+0000","last_fullsized":"2024-02-26T12:20:32.305572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.305470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.305470+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.305470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T20:01:29.123586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.365627+0000","last_change":"2024-02-26T12:20:29.365658+0000","last_active":"2024-02-26T12:20:29.365627+0000","last_peered":"2024-02-26T12:20:29.365627+0000","last_clean":"2024-02-26T12:20:29.365627+0000","last_became_active":"2024-02-26T12:20:05.841768+0000","last_became_peered":"2024-02-26T12:20:05.841768+0000","last_unstale":"2024-02-26T12:20:29.365627+0000","last_undegraded":"2024-02-26T12:20:29.365627+0000","last_fullsized":"2024-02-26T12:20:29.365627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-02-26T12:20:29.365535+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-02-26T12:20:29.365535+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.365535+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:28:16.645241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:36.341405+0000","last_change":"2024-02-26T12:20:36.341431+0000","last_active":"2024-02-26T12:20:36.341405+0000","last_peered":"2024-02-26T12:20:36.341405+0000","last_clean":"2024-02-26T12:20:36.341405+0000","last_became_active":"2024-02-26T12:20:06.836398+0000","last_became_peered":"2024-02-26T12:20:06.836398+0000","last_unstale":"2024-02-26T12:20:36.341405+0000","last_undegraded":"2024-02-26T12:20:36.341405+0000","last_fullsized":"2024-02-26T12:20:36.341405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:36.341317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:36.341317+0000","last_clean_scrub_stamp":"2024-02-26T12:20:36.341317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:15:09.337141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.335649+0000","last_change":"2024-02-26T12:20:28.335695+0000","last_active":"2024-02-26T12:20:28.335649+0000","last_peered":"2024-02-26T12:20:28.335649+0000","last_clean":"2024-02-26T12:20:28.335649+0000","last_became_active":"2024-02-26T12:20:05.845336+0000","last_became_peered":"2024-02-26T12:20:05.845336+0000","last_unstale":"2024-02-26T12:20:28.335649+0000","last_undegraded":"2024-02-26T12:20:28.335649+0000","last_fullsized":"2024-02-26T12:20:28.335649+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-02-26T12:20:28.335546+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-02-26T12:20:28.335546+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.335546+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:09:26.442933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:36.798396+0000","last_change":"2024-02-26T12:20:36.798422+0000","last_active":"2024-02-26T12:20:36.798396+0000","last_peered":"2024-02-26T12:20:36.798396+0000","last_clean":"2024-02-26T12:20:36.798396+0000","last_became_active":"2024-02-26T12:20:06.847468+0000","last_became_peered":"2024-02-26T12:20:06.847468+0000","last_unstale":"2024-02-26T12:20:36.798396+0000","last_undegraded":"2024-02-26T12:20:36.798396+0000","last_fullsized":"2024-02-26T12:20:36.798396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:36.798304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:36.798304+0000","last_clean_scrub_stamp":"2024-02-26T12:20:36.798304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T22:37:30.283738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:34.389908+0000","last_change":"2024-02-26T12:20:34.389936+0000","last_active":"2024-02-26T12:20:34.389908+0000","last_peered":"2024-02-26T12:20:34.389908+0000","last_clean":"2024-02-26T12:20:34.389908+0000","last_became_active":"2024-02-26T12:20:05.845741+0000","last_became_peered":"2024-02-26T12:20:05.845741+0000","last_unstale":"2024-02-26T12:20:34.389908+0000","last_undegraded":"2024-02-26T12:20:34.389908+0000","last_fullsized":"2024-02-26T12:20:34.389908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:34.389811+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:34.389811+0000","last_clean_scrub_stamp":"2024-02-26T12:20:34.389811+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:59:45.986589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:35.301220+0000","last_change":"2024-02-26T12:20:35.301244+0000","last_active":"2024-02-26T12:20:35.301220+0000","last_peered":"2024-02-26T12:20:35.301220+0000","last_clean":"2024-02-26T12:20:35.301220+0000","last_became_active":"2024-02-26T12:20:06.851621+0000","last_became_peered":"2024-02-26T12:20:06.851621+0000","last_unstale":"2024-02-26T12:20:35.301220+0000","last_undegraded":"2024-02-26T12:20:35.301220+0000","last_fullsized":"2024-02-26T12:20:35.301220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:35.301130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:35.301130+0000","last_clean_scrub_stamp":"2024-02-26T12:20:35.301130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:05:07.586919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.334268+0000","last_change":"2024-02-26T12:20:27.334300+0000","last_active":"2024-02-26T12:20:27.334268+0000","last_peered":"2024-02-26T12:20:27.334268+0000","last_clean":"2024-02-26T12:20:27.334268+0000","last_became_active":"2024-02-26T12:20:05.837415+0000","last_became_peered":"2024-02-26T12:20:05.837415+0000","last_unstale":"2024-02-26T12:20:27.334268+0000","last_undegraded":"2024-02-26T12:20:27.334268+0000","last_fullsized":"2024-02-26T12:20:27.334268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-02-26T12:20:27.334172+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-02-26T12:20:27.334172+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.334172+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:47.946641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.308880+0000","last_change":"2024-02-26T12:20:29.308908+0000","last_active":"2024-02-26T12:20:29.308880+0000","last_peered":"2024-02-26T12:20:29.308880+0000","last_clean":"2024-02-26T12:20:29.308880+0000","last_became_active":"2024-02-26T12:20:06.840932+0000","last_became_peered":"2024-02-26T12:20:06.840932+0000","last_unstale":"2024-02-26T12:20:29.308880+0000","last_undegraded":"2024-02-26T12:20:29.308880+0000","last_fullsized":"2024-02-26T12:20:29.308880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.308746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.308746+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.308746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:34:01.422355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.355435+0000","last_change":"2024-02-26T12:20:32.355471+0000","last_active":"2024-02-26T12:20:32.355435+0000","last_peered":"2024-02-26T12:20:32.355435+0000","last_clean":"2024-02-26T12:20:32.355435+0000","last_became_active":"2024-02-26T12:20:05.844776+0000","last_became_peered":"2024-02-26T12:20:05.844776+0000","last_unstale":"2024-02-26T12:20:32.355435+0000","last_undegraded":"2024-02-26T12:20:32.355435+0000","last_fullsized":"2024-02-26T12:20:32.355435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.355340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.355340+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.355340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T12:56:09.104020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.339047+0000","last_change":"2024-02-26T12:20:28.339069+0000","last_active":"2024-02-26T12:20:28.339047+0000","last_peered":"2024-02-26T12:20:28.339047+0000","last_clean":"2024-02-26T12:20:28.339047+0000","last_became_active":"2024-02-26T12:20:06.840813+0000","last_became_peered":"2024-02-26T12:20:06.840813+0000","last_unstale":"2024-02-26T12:20:28.339047+0000","last_undegraded":"2024-02-26T12:20:28.339047+0000","last_fullsized":"2024-02-26T12:20:28.339047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:28.338975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:28.338975+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.338975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:15:18.319550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:26.436226+0000","last_change":"2024-02-26T12:20:26.436249+0000","last_active":"2024-02-26T12:20:26.436226+0000","last_peered":"2024-02-26T12:20:26.436226+0000","last_clean":"2024-02-26T12:20:26.436226+0000","last_became_active":"2024-02-26T12:20:05.838557+0000","last_became_peered":"2024-02-26T12:20:05.838557+0000","last_unstale":"2024-02-26T12:20:26.436226+0000","last_undegraded":"2024-02-26T12:20:26.436226+0000","last_fullsized":"2024-02-26T12:20:26.436226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:26.436145+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:26.436145+0000","last_clean_scrub_stamp":"2024-02-26T12:20:26.436145+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:50:01.606478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.427341+0000","last_change":"2024-02-26T12:20:32.427364+0000","last_active":"2024-02-26T12:20:32.427341+0000","last_peered":"2024-02-26T12:20:32.427341+0000","last_clean":"2024-02-26T12:20:32.427341+0000","last_became_active":"2024-02-26T12:20:06.844533+0000","last_became_peered":"2024-02-26T12:20:06.844533+0000","last_unstale":"2024-02-26T12:20:32.427341+0000","last_undegraded":"2024-02-26T12:20:32.427341+0000","last_fullsized":"2024-02-26T12:20:32.427341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.427246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.427246+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.427246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:38.356895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.300111+0000","last_change":"2024-02-26T12:20:27.300133+0000","last_active":"2024-02-26T12:20:27.300111+0000","last_peered":"2024-02-26T12:20:27.300111+0000","last_clean":"2024-02-26T12:20:27.300111+0000","last_became_active":"2024-02-26T12:20:05.847321+0000","last_became_peered":"2024-02-26T12:20:05.847321+0000","last_unstale":"2024-02-26T12:20:27.300111+0000","last_undegraded":"2024-02-26T12:20:27.300111+0000","last_fullsized":"2024-02-26T12:20:27.300111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:27.300016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:27.300016+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.300016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:36:57.838210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.295993+0000","last_change":"2024-02-26T12:20:27.296012+0000","last_active":"2024-02-26T12:20:27.295993+0000","last_peered":"2024-02-26T12:20:27.295993+0000","last_clean":"2024-02-26T12:20:27.295993+0000","last_became_active":"2024-02-26T12:20:06.835862+0000","last_became_peered":"2024-02-26T12:20:06.835862+0000","last_unstale":"2024-02-26T12:20:27.295993+0000","last_undegraded":"2024-02-26T12:20:27.295993+0000","last_fullsized":"2024-02-26T12:20:27.295993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:27.295904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:27.295904+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.295904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:50:34.365936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:29.313211+0000","last_change":"2024-02-26T12:20:29.313238+0000","last_active":"2024-02-26T12:20:29.313211+0000","last_peered":"2024-02-26T12:20:29.313211+0000","last_clean":"2024-02-26T12:20:29.313211+0000","last_became_active":"2024-02-26T12:20:05.841717+0000","last_became_peered":"2024-02-26T12:20:05.841717+0000","last_unstale":"2024-02-26T12:20:29.313211+0000","last_undegraded":"2024-02-26T12:20:29.313211+0000","last_fullsized":"2024-02-26T12:20:29.313211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:29.313108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:29.313108+0000","last_clean_scrub_stamp":"2024-02-26T12:20:29.313108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:33:57.668941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:32.311506+0000","last_change":"2024-02-26T12:20:32.311548+0000","last_active":"2024-02-26T12:20:32.311506+0000","last_peered":"2024-02-26T12:20:32.311506+0000","last_clean":"2024-02-26T12:20:32.311506+0000","last_became_active":"2024-02-26T12:20:06.842409+0000","last_became_peered":"2024-02-26T12:20:06.842409+0000","last_unstale":"2024-02-26T12:20:32.311506+0000","last_undegraded":"2024-02-26T12:20:32.311506+0000","last_fullsized":"2024-02-26T12:20:32.311506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:32.311384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:32.311384+0000","last_clean_scrub_stamp":"2024-02-26T12:20:32.311384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:08:19.548568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.703476+0000","last_change":"2024-02-26T12:20:27.703499+0000","last_active":"2024-02-26T12:20:27.703476+0000","last_peered":"2024-02-26T12:20:27.703476+0000","last_clean":"2024-02-26T12:20:27.703476+0000","last_became_active":"2024-02-26T12:20:05.837945+0000","last_became_peered":"2024-02-26T12:20:05.837945+0000","last_unstale":"2024-02-26T12:20:27.703476+0000","last_undegraded":"2024-02-26T12:20:27.703476+0000","last_fullsized":"2024-02-26T12:20:27.703476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:27.703388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:27.703388+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.703388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:29:36.648384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.352314+0000","last_change":"2024-02-26T12:20:30.352348+0000","last_active":"2024-02-26T12:20:30.352314+0000","last_peered":"2024-02-26T12:20:30.352314+0000","last_clean":"2024-02-26T12:20:30.352314+0000","last_became_active":"2024-02-26T12:20:06.843177+0000","last_became_peered":"2024-02-26T12:20:06.843177+0000","last_unstale":"2024-02-26T12:20:30.352314+0000","last_undegraded":"2024-02-26T12:20:30.352314+0000","last_fullsized":"2024-02-26T12:20:30.352314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.352207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.352207+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.352207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:18:17.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:25.335971+0000","last_change":"2024-02-26T12:20:25.336033+0000","last_active":"2024-02-26T12:20:25.335971+0000","last_peered":"2024-02-26T12:20:25.335971+0000","last_clean":"2024-02-26T12:20:25.335971+0000","last_became_active":"2024-02-26T12:20:05.839349+0000","last_became_peered":"2024-02-26T12:20:05.839349+0000","last_unstale":"2024-02-26T12:20:25.335971+0000","last_undegraded":"2024-02-26T12:20:25.335971+0000","last_fullsized":"2024-02-26T12:20:25.335971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-26T12:20:25.335857+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-26T12:20:25.335857+0000","last_clean_scrub_stamp":"2024-02-26T12:20:25.335857+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:16:45.948326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:35.781409+0000","last_change":"2024-02-26T12:20:35.781435+0000","last_active":"2024-02-26T12:20:35.781409+0000","last_peered":"2024-02-26T12:20:35.781409+0000","last_clean":"2024-02-26T12:20:35.781409+0000","last_became_active":"2024-02-26T12:20:06.846015+0000","last_became_peered":"2024-02-26T12:20:06.846015+0000","last_unstale":"2024-02-26T12:20:35.781409+0000","last_undegraded":"2024-02-26T12:20:35.781409+0000","last_fullsized":"2024-02-26T12:20:35.781409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:35.781321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:35.781321+0000","last_clean_scrub_stamp":"2024-02-26T12:20:35.781321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:03:39.329570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.405123+0000","last_change":"2024-02-26T12:20:27.405165+0000","last_active":"2024-02-26T12:20:27.405123+0000","last_peered":"2024-02-26T12:20:27.405123+0000","last_clean":"2024-02-26T12:20:27.405123+0000","last_became_active":"2024-02-26T12:20:05.839228+0000","last_became_peered":"2024-02-26T12:20:05.839228+0000","last_unstale":"2024-02-26T12:20:27.405123+0000","last_undegraded":"2024-02-26T12:20:27.405123+0000","last_fullsized":"2024-02-26T12:20:27.405123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-02-26T12:20:27.405011+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-02-26T12:20:27.405011+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.405011+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T18:43:33.334660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:31.376232+0000","last_change":"2024-02-26T12:20:31.376266+0000","last_active":"2024-02-26T12:20:31.376232+0000","last_peered":"2024-02-26T12:20:31.376232+0000","last_clean":"2024-02-26T12:20:31.376232+0000","last_became_active":"2024-02-26T12:20:06.840009+0000","last_became_peered":"2024-02-26T12:20:06.840009+0000","last_unstale":"2024-02-26T12:20:31.376232+0000","last_undegraded":"2024-02-26T12:20:31.376232+0000","last_fullsized":"2024-02-26T12:20:31.376232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:31.376139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:31.376139+0000","last_clean_scrub_stamp":"2024-02-26T12:20:31.376139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:58:02.439427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:27.382581+0000","last_change":"2024-02-26T12:20:27.382601+0000","last_active":"2024-02-26T12:20:27.382581+0000","last_peered":"2024-02-26T12:20:27.382581+0000","last_clean":"2024-02-26T12:20:27.382581+0000","last_became_active":"2024-02-26T12:20:05.839143+0000","last_became_peered":"2024-02-26T12:20:05.839143+0000","last_unstale":"2024-02-26T12:20:27.382581+0000","last_undegraded":"2024-02-26T12:20:27.382581+0000","last_fullsized":"2024-02-26T12:20:27.382581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:27.382494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:27.382494+0000","last_clean_scrub_stamp":"2024-02-26T12:20:27.382494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:31:07.080587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.288702+0000","last_change":"2024-02-26T12:20:30.288747+0000","last_active":"2024-02-26T12:20:30.288702+0000","last_peered":"2024-02-26T12:20:30.288702+0000","last_clean":"2024-02-26T12:20:30.288702+0000","last_became_active":"2024-02-26T12:20:06.843889+0000","last_became_peered":"2024-02-26T12:20:06.843889+0000","last_unstale":"2024-02-26T12:20:30.288702+0000","last_undegraded":"2024-02-26T12:20:30.288702+0000","last_fullsized":"2024-02-26T12:20:30.288702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.288609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.288609+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.288609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:11:26.250073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:25.410194+0000","last_change":"2024-02-26T12:20:25.410230+0000","last_active":"2024-02-26T12:20:25.410194+0000","last_peered":"2024-02-26T12:20:25.410194+0000","last_clean":"2024-02-26T12:20:25.410194+0000","last_became_active":"2024-02-26T12:20:05.837440+0000","last_became_peered":"2024-02-26T12:20:05.837440+0000","last_unstale":"2024-02-26T12:20:25.410194+0000","last_undegraded":"2024-02-26T12:20:25.410194+0000","last_fullsized":"2024-02-26T12:20:25.410194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:25.410080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:25.410080+0000","last_clean_scrub_stamp":"2024-02-26T12:20:25.410080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:18:12.638253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:33.379403+0000","last_change":"2024-02-26T12:20:33.379445+0000","last_active":"2024-02-26T12:20:33.379403+0000","last_peered":"2024-02-26T12:20:33.379403+0000","last_clean":"2024-02-26T12:20:33.379403+0000","last_became_active":"2024-02-26T12:20:06.846604+0000","last_became_peered":"2024-02-26T12:20:06.846604+0000","last_unstale":"2024-02-26T12:20:33.379403+0000","last_undegraded":"2024-02-26T12:20:33.379403+0000","last_fullsized":"2024-02-26T12:20:33.379403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:33.379293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:33.379293+0000","last_clean_scrub_stamp":"2024-02-26T12:20:33.379293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T13:34:01.735126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:26.381864+0000","last_change":"2024-02-26T12:20:26.381897+0000","last_active":"2024-02-26T12:20:26.381864+0000","last_peered":"2024-02-26T12:20:26.381864+0000","last_clean":"2024-02-26T12:20:26.381864+0000","last_became_active":"2024-02-26T12:20:05.840034+0000","last_became_peered":"2024-02-26T12:20:05.840034+0000","last_unstale":"2024-02-26T12:20:26.381864+0000","last_undegraded":"2024-02-26T12:20:26.381864+0000","last_fullsized":"2024-02-26T12:20:26.381864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:26.381769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:26.381769+0000","last_clean_scrub_stamp":"2024-02-26T12:20:26.381769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T16:41:46.156194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:40.338844+0000","last_change":"2024-02-26T12:20:40.338872+0000","last_active":"2024-02-26T12:20:40.338844+0000","last_peered":"2024-02-26T12:20:40.338844+0000","last_clean":"2024-02-26T12:20:40.338844+0000","last_became_active":"2024-02-26T12:20:06.849066+0000","last_became_peered":"2024-02-26T12:20:06.849066+0000","last_unstale":"2024-02-26T12:20:40.338844+0000","last_undegraded":"2024-02-26T12:20:40.338844+0000","last_fullsized":"2024-02-26T12:20:40.338844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:40.338748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:40.338748+0000","last_clean_scrub_stamp":"2024-02-26T12:20:40.338748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:40:44.076613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.338647+0000","last_change":"2024-02-26T12:20:28.338694+0000","last_active":"2024-02-26T12:20:28.338647+0000","last_peered":"2024-02-26T12:20:28.338647+0000","last_clean":"2024-02-26T12:20:28.338647+0000","last_became_active":"2024-02-26T12:20:05.838303+0000","last_became_peered":"2024-02-26T12:20:05.838303+0000","last_unstale":"2024-02-26T12:20:28.338647+0000","last_undegraded":"2024-02-26T12:20:28.338647+0000","last_fullsized":"2024-02-26T12:20:28.338647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:28.338518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:28.338518+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.338518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:52:54.249968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:39.311609+0000","last_change":"2024-02-26T12:20:39.311649+0000","last_active":"2024-02-26T12:20:39.311609+0000","last_peered":"2024-02-26T12:20:39.311609+0000","last_clean":"2024-02-26T12:20:39.311609+0000","last_became_active":"2024-02-26T12:20:06.849397+0000","last_became_peered":"2024-02-26T12:20:06.849397+0000","last_unstale":"2024-02-26T12:20:39.311609+0000","last_undegraded":"2024-02-26T12:20:39.311609+0000","last_fullsized":"2024-02-26T12:20:39.311609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:39.311485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:39.311485+0000","last_clean_scrub_stamp":"2024-02-26T12:20:39.311485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T15:43:13.575016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.345361+0000","last_change":"2024-02-26T12:20:28.345397+0000","last_active":"2024-02-26T12:20:28.345361+0000","last_peered":"2024-02-26T12:20:28.345361+0000","last_clean":"2024-02-26T12:20:28.345361+0000","last_became_active":"2024-02-26T12:20:05.840727+0000","last_became_peered":"2024-02-26T12:20:05.840727+0000","last_unstale":"2024-02-26T12:20:28.345361+0000","last_undegraded":"2024-02-26T12:20:28.345361+0000","last_fullsized":"2024-02-26T12:20:28.345361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:28.345237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:28.345237+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.345237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:14.549156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:30.280034+0000","last_change":"2024-02-26T12:20:30.280059+0000","last_active":"2024-02-26T12:20:30.280034+0000","last_peered":"2024-02-26T12:20:30.280034+0000","last_clean":"2024-02-26T12:20:30.280034+0000","last_became_active":"2024-02-26T12:20:06.839255+0000","last_became_peered":"2024-02-26T12:20:06.839255+0000","last_unstale":"2024-02-26T12:20:30.280034+0000","last_undegraded":"2024-02-26T12:20:30.280034+0000","last_fullsized":"2024-02-26T12:20:30.280034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:30.279931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:30.279931+0000","last_clean_scrub_stamp":"2024-02-26T12:20:30.279931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T19:19:16.483850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.272853+0000","last_change":"2024-02-26T12:20:28.272880+0000","last_active":"2024-02-26T12:20:28.272853+0000","last_peered":"2024-02-26T12:20:28.272853+0000","last_clean":"2024-02-26T12:20:28.272853+0000","last_became_active":"2024-02-26T12:20:05.848240+0000","last_became_peered":"2024-02-26T12:20:05.848240+0000","last_unstale":"2024-02-26T12:20:28.272853+0000","last_undegraded":"2024-02-26T12:20:28.272853+0000","last_fullsized":"2024-02-26T12:20:28.272853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-26T12:20:28.272755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-26T12:20:28.272755+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.272755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T14:50:03.443088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-26T12:20:28.316789+0000","last_change":"2024-02-26T12:20:28.316822+0000","last_active":"2024-02-26T12:20:28.316789+0000","last_peered":"2024-02-26T12:20:28.316789+0000","last_clean":"2024-02-26T12:20:28.316789+0000","last_became_active":"2024-02-26T12:19:08.264410+0000","last_became_peered":"2024-02-26T12:19:08.264410+0000","last_unstale":"2024-02-26T12:20:28.316789+0000","last_undegraded":"2024-02-26T12:20:28.316789+0000","last_fullsized":"2024-02-26T12:20:28.316789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-02-26T12:20:28.316694+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-02-26T12:20:28.316694+0000","last_clean_scrub_stamp":"2024-02-26T12:20:28.316694+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-27T21:29:37.261690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":141293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":141293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-26T12:20:48.236 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-26T12:20:48.374 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.388+0000 7fd90fad5640 1 Processor -- start 2024-02-26T12:20:48.375 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 -- start start 2024-02-26T12:20:48.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd90806df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9080ce540 0x7fd908163d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.377 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9080ca7c0 con 0x7fd90815a250 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90806e4d0 con 0x7fd9080ce540 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.389+0000 7fd90fad5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90806e720 con 0x7fd9080722e0 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9080ce540 0x7fd908163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd9080ce540 0x7fd908163d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55714/0 (socket says 172.21.15.113:55714) 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 -- 172.21.15.113:0/1463504113 learned_addr learned my addr 172.21.15.113:0/1463504113 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90d070640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd90806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 -- 172.21.15.113:0/1463504113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 msgr2=0x7fd90806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:48.378 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd90806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 -- 172.21.15.113:0/1463504113 >> v1:172.21.15.152:6789/0 conn(0x7fd90815a250 legacy=0x7fd908071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90e072640 1 -- 172.21.15.113:0/1463504113 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90806ea00 con 0x7fd9080ce540 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.390+0000 7fd90d070640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd90806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90e072640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908163d20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff0c5dad0dba817 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90c86f640 1 -- 172.21.15.113:0/1463504113 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90002cb00 con 0x7fd9080ce540 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90c86f640 1 -- 172.21.15.113:0/1463504113 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90002cca0 con 0x7fd9080ce540 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90c86f640 1 -- 172.21.15.113:0/1463504113 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900034610 con 0x7fd9080ce540 2024-02-26T12:20:48.379 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 -- 172.21.15.113:0/1463504113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 msgr2=0x7fd908163d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908163d20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd900009e50 tx=0x7fd90002bf60 comp rx=0 tx=0).stop 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 -- 172.21.15.113:0/1463504113 shutdown_connections 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908163d20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 --2- 172.21.15.113:0/1463504113 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd90806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 -- 172.21.15.113:0/1463504113 >> 172.21.15.113:0/1463504113 conn(0x7fd9080cc100 msgr2=0x7fd9080cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 -- 172.21.15.113:0/1463504113 shutdown_connections 2024-02-26T12:20:48.380 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.391+0000 7fd90fad5640 1 -- 172.21.15.113:0/1463504113 wait complete. 2024-02-26T12:20:48.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.393+0000 7fd90fad5640 1 Processor -- start 2024-02-26T12:20:48.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.393+0000 7fd90fad5640 1 -- start start 2024-02-26T12:20:48.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd908152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.383 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 0x7fd9081577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90806f2a0 con 0x7fd9080ce540 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90806efc0 con 0x7fd90815a250 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90fad5640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9080ca9f0 con 0x7fd9080722e0 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:55720/0 (socket says 172.21.15.113:55720) 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 -- 172.21.15.113:0/2642087155 learned_addr learned my addr 172.21.15.113:0/2642087155 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90e072640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 0x7fd9081577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.384 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 -- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 msgr2=0x7fd908152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd908152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 -- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 msgr2=0x7fd9081577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 0x7fd9081577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 -- 172.21.15.113:0/2642087155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908152cb0 con 0x7fd9080ce540 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90e072640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 0x7fd9081577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd90d070640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e7e0 tx=0x7fd8f800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.394+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800f040 con 0x7fd9080ce540 2024-02-26T12:20:48.385 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.395+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8004030 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.395+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd908152f70 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.395+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8004400 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.395+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd908153530 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.396+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9080686b0 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.396+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8f800c6d0 con 0x7fd9080ce540 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.397+0000 7fd8fe7fc640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 0x7fd8ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.386 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.397+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8f8089f60 con 0x7fd9080ce540 2024-02-26T12:20:48.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.397+0000 7fd90d871640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 0x7fd8ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.397+0000 7fd90d871640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 0x7fd8ec06d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd904000f60 tx=0x7fd9040079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.387 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.401+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9080686b0 con 0x7fd9080ce540 2024-02-26T12:20:48.567 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.581+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd9080b0dd0 con 0x7fd9080ce540 2024-02-26T12:20:48.570 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.584+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd8f8017020 con 0x7fd9080ce540 2024-02-26T12:20:48.572 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.586+0000 7fd8fe7fc640 1 -- 172.21.15.113:0/2642087155 <== mon.0 v2:172.21.15.113:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8f8058de0 con 0x7fd9080ce540 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.587+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 msgr2=0x7fd8ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.587+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 0x7fd8ec06d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd904000f60 tx=0x7fd9040079d0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.587+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 msgr2=0x7fd908157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.587+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e7e0 tx=0x7fd8f800eca0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 shutdown_connections 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7fd8ec06b500 0x7fd8ec06d9c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.574 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd90815a250 0x7fd9081577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9080ce540 0x7fd908157280 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 --2- 172.21.15.113:0/2642087155 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9080722e0 0x7fd908152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 >> 172.21.15.113:0/2642087155 conn(0x7fd9080cc100 msgr2=0x7fd908158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 shutdown_connections 2024-02-26T12:20:48.575 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.588+0000 7fd90fad5640 1 -- 172.21.15.113:0/2642087155 wait complete. 2024-02-26T12:20:48.585 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-26T12:20:48.585 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-26T12:20:48.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.701+0000 7f6c5da36640 1 Processor -- start 2024-02-26T12:20:48.687 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.701+0000 7f6c5da36640 1 -- start start 2024-02-26T12:20:48.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c5da36640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c580aed50 0x7f6c5815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c5da36640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6c5815bf80 0x7f6c5815c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c5da36640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5815eb60 con 0x7f6c5806d250 2024-02-26T12:20:48.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c5da36640 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580af130 con 0x7f6c580aed50 2024-02-26T12:20:48.689 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c5da36640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5815ee40 con 0x7f6c5815bf80 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c580aed50 0x7f6c5815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c580aed50 0x7f6c5815e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54260/0 (socket says 172.21.15.113:54260) 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 -- 172.21.15.113:0/1664192743 learned_addr learned my addr 172.21.15.113:0/1664192743 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 -- 172.21.15.113:0/1664192743 >> v2:172.21.15.152:3300/0 conn(0x7f6c5815bf80 msgr2=0x7f6c5815c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c577fe640 1 --2- 172.21.15.113:0/1664192743 >> v2:172.21.15.152:3300/0 conn(0x7f6c5815bf80 0x7f6c5815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 --2- 172.21.15.113:0/1664192743 >> v2:172.21.15.152:3300/0 conn(0x7f6c5815bf80 0x7f6c5815c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 -- 172.21.15.113:0/1664192743 >> v1:172.21.15.152:6789/0 conn(0x7f6c5806d250 legacy=0x7f6c580b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-26T12:20:48.690 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.702+0000 7f6c56ffd640 1 -- 172.21.15.113:0/1664192743 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5815f120 con 0x7f6c580aed50 2024-02-26T12:20:48.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.703+0000 7f6c56ffd640 1 --2- 172.21.15.113:0/1664192743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c580aed50 0x7f6c5815e460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c580cc3d0 tx=0x7f6c4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab337c1ed5687ac3 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.703+0000 7f6c55ffb640 1 -- 172.21.15.113:0/1664192743 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48035020 con 0x7f6c580aed50 2024-02-26T12:20:48.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.703+0000 7f6c55ffb640 1 -- 172.21.15.113:0/1664192743 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c48031870 con 0x7f6c580aed50 2024-02-26T12:20:48.691 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.703+0000 7f6c55ffb640 1 -- 172.21.15.113:0/1664192743 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48031c60 con 0x7f6c580aed50 2024-02-26T12:20:48.694 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 -- 172.21.15.113:0/1664192743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c580aed50 msgr2=0x7f6c5815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 --2- 172.21.15.113:0/1664192743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c580aed50 0x7f6c5815e460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6c580cc3d0 tx=0x7f6c4802b910 comp rx=0 tx=0).stop 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 -- 172.21.15.113:0/1664192743 shutdown_connections 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 --2- 172.21.15.113:0/1664192743 >> v2:172.21.15.152:3300/0 conn(0x7f6c5815bf80 0x7f6c5815c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 --2- 172.21.15.113:0/1664192743 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c580aed50 0x7f6c5815e460 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 -- 172.21.15.113:0/1664192743 >> 172.21.15.113:0/1664192743 conn(0x7f6c5806ab50 msgr2=0x7f6c5806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 -- 172.21.15.113:0/1664192743 shutdown_connections 2024-02-26T12:20:48.695 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.704+0000 7f6c5da36640 1 -- 172.21.15.113:0/1664192743 wait complete. 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.705+0000 7f6c5da36640 1 Processor -- start 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.705+0000 7f6c5da36640 1 -- start start 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c580aed50 0x7f6c58148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c5815bf80 0x7f6c580711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b4050 con 0x7f6c5806d250 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b3420 con 0x7f6c580aed50 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c5da36640 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b41d0 con 0x7f6c5815bf80 2024-02-26T12:20:48.696 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:54264/0 (socket says 172.21.15.113:54264) 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 -- 172.21.15.113:0/4275907350 learned_addr learned my addr 172.21.15.113:0/4275907350 (peer_addr_for_me v2:172.21.15.113:0/0) 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c567fc640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c580aed50 0x7f6c58148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c577fe640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c5815bf80 0x7f6c580711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 -- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c5815bf80 msgr2=0x7f6c580711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c5815bf80 0x7f6c580711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 -- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c580aed50 msgr2=0x7f6c58148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.697 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c580aed50 0x7f6c58148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 -- 172.21.15.113:0/4275907350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c581530b0 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.706+0000 7f6c56ffd640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c48000c00 tx=0x7f6c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.707+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48040070 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.707+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6c4803a420 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.707+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48035040 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.707+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c58153390 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.707+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c58153950 con 0x7f6c5806d250 2024-02-26T12:20:48.698 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.708+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58074a50 con 0x7f6c5806d250 2024-02-26T12:20:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.708+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c4804b060 con 0x7f6c5806d250 2024-02-26T12:20:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.708+0000 7f6c3ffff640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 0x7f6c4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-26T12:20:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.709+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c480ac220 con 0x7f6c5806d250 2024-02-26T12:20:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.709+0000 7f6c567fc640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 0x7f6c4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-26T12:20:48.699 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.709+0000 7f6c567fc640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 0x7f6c4406d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6c580cbc00 tx=0x7f6c4c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-26T12:20:48.702 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.716+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c4807b010 con 0x7f6c5806d250 2024-02-26T12:20:48.702 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:48.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:48.920 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.935+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c580af2c0 con 0x7f6c5806d250 2024-02-26T12:20:48.921 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.935+0000 7f6c3ffff640 1 -- 172.21.15.113:0/4275907350 <== mon.0 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f6c4807a910 con 0x7f6c5806d250 2024-02-26T12:20:48.921 INFO:teuthology.orchestra.run.smithi113.stdout: 2024-02-26T12:20:48.922 INFO:teuthology.orchestra.run.smithi113.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6837/584883378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6836","nonce":584883378},{"type":"v1","addr":"172.21.15.113:6837","nonce":584883378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6834/125186533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":125186533},{"type":"v1","addr":"172.21.15.152:6834","nonce":125186533}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6835/963040340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6833","nonce":963040340},{"type":"v1","addr":"172.21.15.152:6835","nonce":963040340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-26T12:20:06.176062+0000","modified":"2024-02-26T12:20:08.174361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5019},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5019":{"gid":5019,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.113:6835/2648726034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2648726034},{"type":"v1","addr":"172.21.15.113:6835","nonce":2648726034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-02-26T12:20:48.922 INFO:teuthology.orchestra.run.smithi113.stderr:dumped fsmap epoch 14 2024-02-26T12:20:48.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 msgr2=0x7f6c4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 0x7f6c4406d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6c580cbc00 tx=0x7f6c4c007e30 comp rx=0 tx=0).stop 2024-02-26T12:20:48.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 msgr2=0x7f6c580cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-26T12:20:48.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6c48000c00 tx=0x7f6c480046c0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.924 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 shutdown_connections 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:6832/734952106,v1:172.21.15.113:6833/734952106] conn(0x7f6c4406b4d0 0x7f6c4406d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c5815bf80 0x7f6c580711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.937+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c580aed50 0x7f6c58148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.938+0000 7f6c5da36640 1 --2- 172.21.15.113:0/4275907350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c5806d250 0x7f6c580cf3c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.938+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 >> 172.21.15.113:0/4275907350 conn(0x7f6c5806ab50 msgr2=0x7f6c580b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.938+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 shutdown_connections 2024-02-26T12:20:48.925 INFO:teuthology.orchestra.run.smithi113.stderr:2024-02-26T12:20:48.938+0000 7f6c5da36640 1 -- 172.21.15.113:0/4275907350 wait complete. 2024-02-26T12:20:48.934 DEBUG:tasks.cephfs.filesystem:already dead... 2024-02-26T12:20:48.934 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-26T12:20:48.935 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-26T12:20:48.935 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:48.944 INFO:tasks.ceph.mds.a:Stopped 2024-02-26T12:20:48.944 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-26T12:20:48.944 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:48.996 INFO:tasks.ceph.mds.c:Stopped 2024-02-26T12:20:48.996 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-26T12:20:48.997 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.009 INFO:tasks.ceph.mds.b:Stopped 2024-02-26T12:20:49.009 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-26T12:20:49.009 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.061 INFO:tasks.ceph.mds.d:Stopped 2024-02-26T12:20:49.061 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-26T12:20:49.061 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-26T12:20:49.062 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.097 INFO:tasks.ceph.osd.0:Stopped 2024-02-26T12:20:49.098 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-26T12:20:49.098 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.173 INFO:tasks.ceph.osd.1:Stopped 2024-02-26T12:20:49.174 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-26T12:20:49.174 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.257 INFO:tasks.ceph.osd.2:Stopped 2024-02-26T12:20:49.258 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-26T12:20:49.258 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.291 INFO:tasks.ceph.osd.3:Stopped 2024-02-26T12:20:49.292 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-26T12:20:49.292 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.328 INFO:tasks.ceph.osd.4:Stopped 2024-02-26T12:20:49.328 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-26T12:20:49.328 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.398 INFO:tasks.ceph.osd.5:Stopped 2024-02-26T12:20:49.399 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-26T12:20:49.399 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.473 INFO:tasks.ceph.osd.6:Stopped 2024-02-26T12:20:49.473 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-26T12:20:49.473 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.546 INFO:tasks.ceph.osd.7:Stopped 2024-02-26T12:20:49.546 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-26T12:20:49.546 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-26T12:20:49.547 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.572 INFO:tasks.ceph.mgr.y:Stopped 2024-02-26T12:20:49.572 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-26T12:20:49.572 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.614 INFO:tasks.ceph.mgr.x:Stopped 2024-02-26T12:20:49.614 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-26T12:20:49.614 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-26T12:20:49.615 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.625 INFO:tasks.ceph.mon.a:Stopped 2024-02-26T12:20:49.625 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-26T12:20:49.626 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.667 INFO:tasks.ceph.mon.b:Stopped 2024-02-26T12:20:49.668 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-26T12:20:49.668 INFO:teuthology.orchestra.run:waiting for 300 2024-02-26T12:20:49.720 INFO:tasks.ceph.mon.c:Stopped 2024-02-26T12:20:49.720 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-26T12:20:49.720 DEBUG:teuthology.orchestra.run.smithi113:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-02-26T12:20:49.753 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:49.753 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-26T12:20:50.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:50.044 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-26T12:20:50.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:50.120 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-26T12:20:50.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:50.168 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-26T12:20:50.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:20:50.227 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-26T12:20:50.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:20:50.385 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-26T12:20:50.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:20:50.450 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-26T12:20:50.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:20:50.506 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-26T12:20:50.557 INFO:tasks.ceph:Archiving mon data... 2024-02-26T12:20:50.559 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/data/mon.a.tgz 2024-02-26T12:20:50.559 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2024-02-26T12:20:50.575 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.KWXLTa0zm3 2024-02-26T12:20:50.576 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KWXLTa0zm3 2024-02-26T12:20:50.701 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.KWXLTa0zm3 2024-02-26T12:20:50.786 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.KWXLTa0zm3 is 269KB 2024-02-26T12:20:50.881 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.KWXLTa0zm3 2024-02-26T12:20:50.896 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/data/mon.b.tgz 2024-02-26T12:20:50.896 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-02-26T12:20:50.913 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.UgOWbbxfQK 2024-02-26T12:20:50.913 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UgOWbbxfQK 2024-02-26T12:20:51.061 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.UgOWbbxfQK 2024-02-26T12:20:51.147 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.UgOWbbxfQK is 364KB 2024-02-26T12:20:51.214 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.UgOWbbxfQK 2024-02-26T12:20:51.230 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/data/mon.c.tgz 2024-02-26T12:20:51.230 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-02-26T12:20:51.282 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.Xu5ly53Gdf 2024-02-26T12:20:51.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Xu5ly53Gdf 2024-02-26T12:20:51.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.Xu5ly53Gdf 2024-02-26T12:20:51.501 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.Xu5ly53Gdf is 364KB 2024-02-26T12:20:51.573 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.Xu5ly53Gdf 2024-02-26T12:20:51.588 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-26T12:20:51.588 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-26T12:20:51.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-26T12:20:51.673 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-26T12:20:51.711 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-26T12:20:51.711 INFO:tasks.ceph:Archiving crash dumps... 2024-02-26T12:20:51.712 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi113/crash 2024-02-26T12:20:51.713 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-26T12:20:51.742 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi152/crash 2024-02-26T12:20:51.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-26T12:20:51.776 INFO:tasks.ceph:Shutting down logrotate 2024-02-26T12:20:51.777 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:51.787 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:51.876 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:51.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-26T12:20:51.930 INFO:tasks.ceph:Compressing logs... 2024-02-26T12:20:51.931 DEBUG:teuthology.orchestra.run.smithi113:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-26T12:20:51.946 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-26T12:20:52.018 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37530.log 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44334.log 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37410.log: gzip -5 --verbose 89.0% -- /var/log/ceph/ceph-client.admin.37290.log -- replaced with /var/log/ceph/ceph-client.admin.37530.log.gz 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-26T12:20:52.019 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43944.log 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.3.44334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44334.log.gz 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37290.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.1.43944.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37290.log.gz 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43944.log.gz 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-26T12:20:52.020 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37490.log 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37370.log 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37490.log: gzip -5 91.5% --verbose -- -- replaced with /var/log/ceph/ceph-mds.b.log.gz /var/log/ceph/ceph-client.admin.37250.log 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37370.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37490.log.gz 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37250.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37370.log.gz 2024-02-26T12:20:52.021 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37250.log.gz 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37330.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37450.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-02-26T12:20:52.022 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-26T12:20:52.023 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-26T12:20:52.023 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-26T12:20:52.023 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-26T12:20:52.023 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-26T12:20:52.052 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.c.log: 94.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-26T12:20:52.065 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-26T12:20:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-02-26T12:20:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-26T12:20:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2024-02-26T12:20:52.066 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mon.a.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49349.log 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49084.log: /var/log/ceph/ceph-client.admin.49349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49687.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49349.log.gz 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51767.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2024-02-26T12:20:52.067 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46182.log 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49210.log 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46182.log.gz 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2024-02-26T12:20:52.068 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gz 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48123.log 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2%/var/log/ceph/ceph-client.admin.49254.log: -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43158.log 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44152.log 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2024-02-26T12:20:52.069 INFO:teuthology.orchestra.run.smithi113.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48123.log.gz 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46896.log 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43158.log.gz/var/log/ceph/ceph-client.admin.44152.log: 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49939.log 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44152.log.gz 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46896.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48831.log 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49939.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46896.log.gz 2024-02-26T12:20:52.070 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44856.log 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49939.log.gz 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51264.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48831.log.gz 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44898.log 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44856.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2%/var/log/ceph/ceph-client.admin.44898.log: -- replaced with /var/log/ceph/ceph-client.admin.44856.log.gz 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45884.log 2024-02-26T12:20:52.071 INFO:teuthology.orchestra.run.smithi113.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44898.log.gz 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48789.log 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.2.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48916.log 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45884.log.gz 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48916.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48789.log.gz 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47380.log 2024-02-26T12:20:52.072 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48916.log.gz 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46980.log 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47380.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz -5 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50467.log 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47380.log.gz 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46980.log.gz 2024-02-26T12:20:52.073 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42548.log 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49813.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50467.log.gz 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46098.log 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42548.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42548.log.gz 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37198.log 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5/var/log/ceph/ceph-client.admin.42944.log: --verbose -- /var/log/ceph/ceph-client.admin.51474.log 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46098.log.gz 2024-02-26T12:20:52.074 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.37198.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37198.log.gz 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46014.log 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51474.log.gz 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46014.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2024-02-26T12:20:52.075 INFO:teuthology.orchestra.run.smithi113.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46014.log.gz 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42902.log 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42902.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42902.log.gz 2024-02-26T12:20:52.076 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50005.log 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44394.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50005.log.gz 2024-02-26T12:20:52.077 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51684.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49477.log 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49126.log 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49477.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48873.log 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49477.log.gz/var/log/ceph/ceph-client.admin.49126.log: 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2024-02-26T12:20:52.078 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48873.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49126.log.gz 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43070.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.48873.log.gz -5 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46644.log 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42986.log 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46644.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44604.log 2024-02-26T12:20:52.079 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46644.log.gz 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47709.log 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44604.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.51012.log 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42986.log.gz 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47709.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44604.log.gz 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47709.log.gz 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2024-02-26T12:20:52.080 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47133.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48207.log 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43512.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2024-02-26T12:20:52.081 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51306.log 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48207.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47490.log 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48207.log.gz 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51306.log.gz 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51558.log 2024-02-26T12:20:52.082 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47490.log.gz 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51558.log.gz 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2024-02-26T12:20:52.083 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43218.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46434.log 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51390.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49298.log 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46434.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46434.log.gz 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49391.log 2024-02-26T12:20:52.084 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51096.log 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49298.log.gz 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49391.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49391.log.gz 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43815.log 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46392.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.51096.log.gz -- 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr: /var/log/ceph/ceph-client.admin.37567.log 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2024-02-26T12:20:52.085 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48333.log 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43815.log.gz 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.37567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48333.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37567.log.gz 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31123.log 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43114.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48333.log.gz 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51180.log 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.tmp-client.admin.31123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-02-26T12:20:52.086 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43470.log 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31123.log.gz 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51180.log.gz 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50970.log 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43470.log.gz 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-02-26T12:20:52.087 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43344.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50970.log.gz 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49645.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44772.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51726.log 2024-02-26T12:20:52.088 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48165.log 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51726.log.gz 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47422.log 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48165.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2024-02-26T12:20:52.089 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48165.log.gz/var/log/ceph/ceph-client.admin.47422.log: 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44730.log 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47422.log.gz 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44730.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44730.log.gz 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43596.log 2024-02-26T12:20:52.090 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42859.log: /var/log/ceph/ceph-client.admin.51600.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49855.log 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44478.log 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43596.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43596.log.gz 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50886.log 2024-02-26T12:20:52.091 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49855.log.gz 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46812.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44478.log.gz 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51054.log 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50886.log.gz 2024-02-26T12:20:52.092 INFO:teuthology.orchestra.run.smithi113.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51054.log.gz 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48291.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49000.log: /var/log/ceph/ceph-client.admin.47217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-02-26T12:20:52.093 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46686.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46728.log 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46518.log 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.46728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46728.log.gz 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-02-26T12:20:52.094 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43811.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46518.log.gz 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47534.log: gzip -5 --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr: -- /var/log/ceph/ceph-client.admin.43260.log 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48417.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43260.log: /var/log/ceph/ceph-client.admin.42817.log: gzip -5 --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-02-26T12:20:52.095 INFO:teuthology.orchestra.run.smithi113.stderr: -- /var/log/ceph/ceph-client.admin.49042.log 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49042.log.gz 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-02-26T12:20:52.096 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43028.log 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45584.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2024-02-26T12:20:52.097 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46854.log 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43028.log.gz 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48501.log 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44150.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46854.log.gz 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44688.log 2024-02-26T12:20:52.098 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48501.log.gz 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43817.log 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43302.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44688.log.gz 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43817.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2024-02-26T12:20:52.099 INFO:teuthology.orchestra.run.smithi113.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43817.log.gz 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43386.log 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51642.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-02-26T12:20:52.100 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44141.log 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43386.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51138.log 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44982.log 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44141.log.gz 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.51138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44646.log 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44982.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51138.log.gz 2024-02-26T12:20:52.101 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46308.log 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44646.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44982.log.gz 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr: -- /var/log/ceph/ceph-client.admin.50509.log 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44646.log.gz 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46308.log.gz 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-02-26T12:20:52.102 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49433.log 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49433.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49433.log.gz 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2024-02-26T12:20:52.103 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50928.log 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.0.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50551.log 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37448.log 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:20:52.104 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50551.log: /var/log/ceph/ceph-client.admin.37448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44153.log 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.45120.log: 89.1% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50551.log.gz 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37448.log.gz 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44520.log 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44153.log.gz/var/log/ceph/ceph-client.admin.44155.log: 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2024-02-26T12:20:52.105 INFO:teuthology.orchestra.run.smithi113.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50192.log 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44520.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49168.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44520.log.gz 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.0.50192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50192.log.gz 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46266.log 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47793.log 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46266.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-26T12:20:52.106 INFO:teuthology.orchestra.run.smithi113.stderr: 84.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46266.log.gz 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr: -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.47793.log: 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47793.log.gz 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43820.log 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr: 89.3%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44814.log 2024-02-26T12:20:52.107 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.43820.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43820.log.gz 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.44814.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44814.log.gz 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46350.log 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47871.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46350.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46350.log.gz 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46938.log 2024-02-26T12:20:52.108 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48707.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42640.log 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49897.log 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46938.log.gz 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.42640.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42640.log.gz 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46140.log 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49897.log: -- /var/log/ceph/ceph-client.admin.48249.log 2024-02-26T12:20:52.109 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49897.log.gz 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46140.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46140.log.gz 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48543.log 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45453.log 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48375.log 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.0.45453.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48543.log.gz 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45453.log.gz 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2024-02-26T12:20:52.110 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48375.log: /var/log/ceph/ceph-client.admin.44156.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48375.log.gz 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.48039.log: /var/log/ceph/ceph-client.admin.49603.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-02-26T12:20:52.111 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.49561.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.50635.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46476.log 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.47955.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 89.3% 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.46476.log: -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-02-26T12:20:52.112 INFO:teuthology.orchestra.run.smithi113.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46476.log.gz 2024-02-26T12:20:52.113 INFO:teuthology.orchestra.run.smithi113.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-26T12:20:52.114 INFO:teuthology.orchestra.run.smithi113.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-26T12:20:52.114 INFO:teuthology.orchestra.run.smithi152.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-26T12:20:52.114 INFO:teuthology.orchestra.run.smithi152.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-26T12:20:52.114 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-26T12:20:52.122 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-26T12:20:52.124 INFO:teuthology.orchestra.run.smithi113.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-26T12:20:52.130 INFO:teuthology.orchestra.run.smithi113.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-26T12:20:52.137 INFO:teuthology.orchestra.run.smithi113.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-26T12:20:52.139 INFO:teuthology.orchestra.run.smithi113.stderr: 2024-02-26T12:20:52.139 INFO:teuthology.orchestra.run.smithi113.stderr:real 0m0.181s 2024-02-26T12:20:52.139 INFO:teuthology.orchestra.run.smithi113.stderr:user 0m0.712s 2024-02-26T12:20:52.140 INFO:teuthology.orchestra.run.smithi113.stderr:sys 0m0.136s 2024-02-26T12:20:52.151 INFO:teuthology.orchestra.run.smithi152.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-26T12:20:52.153 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-02-26T12:20:52.153 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m0.165s 2024-02-26T12:20:52.153 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m0.645s 2024-02-26T12:20:52.153 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.048s 2024-02-26T12:20:52.154 INFO:tasks.ceph:Archiving logs... 2024-02-26T12:20:52.154 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi113/log 2024-02-26T12:20:52.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-26T12:20:52.440 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi152/log 2024-02-26T12:20:52.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-26T12:20:52.564 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-26T12:20:52.575 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-26T12:20:52.575 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-26T12:20:52.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-26T12:20:52.662 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-26T12:20:52.677 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-26T12:20:52.678 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-26T12:20:52.681 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-26T12:20:52.692 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 1: ntpq: command not found 2024-02-26T12:20:52.695 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:=============================================================================== 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +3469us[+3458us] +/- 96ms 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -2930us[-2942us] +/- 66ms 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +693us[ +681us] +/- 74ms 2024-02-26T12:20:52.696 INFO:teuthology.orchestra.run.smithi113.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:20:52.698 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-26T12:20:52.699 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-02-26T12:20:52.699 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +3481us[+3481us] +/- 96ms 2024-02-26T12:20:52.699 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -2943us[-2936us] +/- 66ms 2024-02-26T12:20:52.699 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +691us[ +698us] +/- 74ms 2024-02-26T12:20:52.699 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-26T12:20:52.700 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-26T12:20:52.710 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-26T12:20:52.710 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-26T12:20:52.798 DEBUG:teuthology.orchestra.run.smithi113:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-26T12:20:52.868 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-26T12:20:52.935 DEBUG:teuthology.orchestra.run.smithi113:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-26T12:20:52.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:52.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-26T12:20:52.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:52.995 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-26T12:20:53.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-26T12:20:53.014 INFO:teuthology.task.internal:Duration was 557.137396 seconds 2024-02-26T12:20:53.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-26T12:20:53.023 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-26T12:20:53.023 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-26T12:20:53.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-26T12:20:53.066 INFO:teuthology.orchestra.run.smithi113.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-26T12:20:53.078 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-26T12:20:53.368 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-26T12:20:53.368 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2024-02-26T12:20:53.368 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-26T12:20:53.414 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-02-26T12:20:53.415 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-26T12:20:53.434 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-26T12:20:53.434 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-26T12:20:53.457 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-26T12:20:53.502 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-26T12:20:53.503 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-26T12:20:53.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-26T12:20:53.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-26T12:20:53.651 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-26T12:20:53.651 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-26T12:20:53.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-26T12:20:53.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-26T12:20:53.715 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-26T12:20:53.721 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-26T12:20:53.744 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2024-02-26T12:20:53.770 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-02-26T12:20:53.786 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-26T12:20:53.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:53.813 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-26T12:20:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-26T12:20:53.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-26T12:20:53.851 INFO:teuthology.task.internal:Transferring archived files... 2024-02-26T12:20:53.852 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi113 2024-02-26T12:20:53.852 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-26T12:20:53.890 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678/remote/smithi152 2024-02-26T12:20:53.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-26T12:20:53.925 INFO:teuthology.task.internal:Removing archive directory... 2024-02-26T12:20:53.926 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-26T12:20:53.928 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-26T12:20:53.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-26T12:20:53.987 INFO:teuthology.task.internal:Not uploading archives. 2024-02-26T12:20:53.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-26T12:20:53.997 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-26T12:20:53.997 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-26T12:20:54.000 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-26T12:20:54.011 INFO:teuthology.orchestra.run.smithi113.stdout: 266030 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 12:20 /home/ubuntu/cephtest 2024-02-26T12:20:54.030 INFO:teuthology.orchestra.run.smithi152.stdout: 265293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 26 12:20 /home/ubuntu/cephtest 2024-02-26T12:20:54.031 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-26T12:20:54.042 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-26T12:20:54.065 INFO:teuthology.nuke:Checking targets against current locks 2024-02-26T12:20:54.091 DEBUG:teuthology.nuke:shortname: smithi113 2024-02-26T12:20:54.092 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-26T12:20:54.112 DEBUG:teuthology.nuke:shortname: smithi152 2024-02-26T12:20:54.112 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-26T12:20:54.119 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-26 12:02:44.990607', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMgzMb4SBKi8jhHofJlLFfmtu836Acx1Nmgnsi5e34UU9FNLewFT06lf/7kXOXGo6XbXAkGBYBbeyslye0Ym2ro='} 2024-02-26T12:20:54.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-26_10:07:12-fs-wip-vshankar-testing-20240226.064629-testing-default-smithi/7573678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-26 12:02:44.992549', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCag7Cl00dKINPOhDr8vMoN/vVbOxSZ+rsYvCBXbF+WaVLA0F4xNLBQLYfsRmQrIYUcpfsBBpcfvzv2z7J+sE9w='} 2024-02-26T12:20:54.163 INFO:teuthology.orchestra.console.smithi113:Power off 2024-02-26T12:20:54.164 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-26T12:20:54.182 INFO:teuthology.orchestra.console.smithi152:Power off 2024-02-26T12:20:54.182 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-26T12:20:54.191 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2024-02-26T12:20:54.192 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:20:54.204 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-02-26T12:20:54.204 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:20:54.217 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-26T12:20:54.226 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-02-26T12:20:58.219 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:20:58.229 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:20:58.331 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2024-02-26T12:20:58.370 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-02-26T12:21:02.370 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:21:02.379 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-26T12:21:02.482 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2024-02-26T12:21:02.491 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-02-26T12:21:02.584 INFO:teuthology.orchestra.console.smithi113:Power off completed 2024-02-26T12:21:02.593 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-02-26T12:21:02.698 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 557.1373956203461 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3448385e366d49b8bd02bed60561c761 status: fail success: false 2024-02-26T12:21:02.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-26T12:21:02.785 INFO:teuthology.run:FAIL